Jul 27 21:04:33.877219 ip-10-0-139-153 systemd[1]: Starting Kubernetes Kubelet... Jul 27 21:04:34.322890 ip-10-0-139-153 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 21:04:34.322890 ip-10-0-139-153 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 21:04:34.322890 ip-10-0-139-153 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 21:04:34.322890 ip-10-0-139-153 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 21:04:34.322890 ip-10-0-139-153 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 21:04:34.324102 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.323867 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 21:04:34.331754 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331719 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:34.331754 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331748 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:34.331754 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331752 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:34.331754 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331755 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:34.331754 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331758 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:34.331754 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331762 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331765 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331768 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331771 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331776 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331779 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331782 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331785 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331788 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331791 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331794 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331796 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331799 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331802 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331804 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331807 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331809 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331812 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331815 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331819 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:34.332011 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331822 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331825 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331827 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331830 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331832 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331835 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331838 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331841 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331843 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331846 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331848 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331851 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331853 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331858 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331861 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331864 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331867 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331869 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331872 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:34.332489 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331890 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331896 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331899 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331902 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331905 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331907 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331910 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331913 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331916 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331919 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331921 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331924 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331927 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331930 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331933 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331936 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331939 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331941 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331951 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331956 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:34.332958 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331959 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331961 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331964 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331967 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331970 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331972 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331975 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331978 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331982 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331985 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331988 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331990 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331993 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331996 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.331998 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332001 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332004 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332006 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332009 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:34.333480 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332013 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332016 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332019 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332021 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332024 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332027 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332029 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332032 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332035 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332038 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332041 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332043 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332046 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332048 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332052 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332056 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332827 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332835 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332838 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332842 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:34.333952 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332846 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332849 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332852 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332855 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332858 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332860 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332863 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332866 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332868 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332871 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332895 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332898 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332901 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332905 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332907 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332910 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332912 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332915 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332920 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332924 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:34.334434 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332927 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332930 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332933 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332936 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332939 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332942 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332944 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332947 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332950 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332953 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332956 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332959 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332962 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332965 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332967 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332971 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332974 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332977 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332980 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332982 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:34.334943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332985 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332988 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332990 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332993 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332996 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.332998 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333002 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333004 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333007 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333010 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333012 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333015 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333017 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333020 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333023 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333025 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333028 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333031 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333033 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:34.335430 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333036 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333038 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333041 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333044 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333046 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333049 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333052 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333054 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333056 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333059 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333061 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333064 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333066 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333069 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333074 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333077 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333080 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333083 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333085 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:34.335908 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333088 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333092 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333095 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333098 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333101 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333103 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333106 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333108 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333111 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333113 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333117 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333119 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333122 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333125 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333127 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333130 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333132 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333531 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333536 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333538 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:34.336382 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333541 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333543 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333546 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333548 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333552 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333556 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333559 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333561 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333564 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333566 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333569 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333572 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333574 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333577 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333580 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333582 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333585 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333588 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333590 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:34.336860 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333593 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333595 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333598 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333601 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333603 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333605 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333608 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333611 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333613 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333615 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333618 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333620 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333623 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333625 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333628 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333630 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333632 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333635 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333637 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:34.337341 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333641 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333644 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333648 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333651 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333654 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333657 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333660 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333663 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333666 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333668 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333671 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333674 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333677 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333679 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333682 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333684 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333687 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333690 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333692 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:34.337796 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333695 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333698 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333700 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333703 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333705 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333708 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333710 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333712 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333715 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333717 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333720 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333722 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333724 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333727 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333729 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333732 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333734 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333737 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333740 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333744 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:34.338314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333747 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333750 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333753 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333756 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333759 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333761 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333764 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333766 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333769 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333771 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333774 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333776 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333779 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333782 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333784 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333787 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333789 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333792 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.333794 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333870 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333895 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 21:04:34.338820 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333906 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333912 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333918 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333922 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333926 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333930 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333933 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333936 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333940 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333943 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333946 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333949 2575 flags.go:64] FLAG: --cgroup-root="" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333952 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333955 2575 flags.go:64] FLAG: --client-ca-file="" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333959 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333962 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333968 2575 flags.go:64] FLAG: --cluster-domain="" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333970 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333973 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333976 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333980 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333983 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333986 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 21:04:34.339355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333990 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333993 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333995 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.333998 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334001 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334004 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334007 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334011 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334014 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334017 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334020 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334022 2575 flags.go:64] FLAG: --enable-server="true" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334025 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334030 2575 flags.go:64] FLAG: --event-burst="100" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334032 2575 flags.go:64] FLAG: --event-qps="50" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334035 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334038 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334041 2575 flags.go:64] FLAG: --eviction-hard="" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334044 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334047 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334050 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334053 2575 flags.go:64] FLAG: --eviction-soft="" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334055 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334058 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334062 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 21:04:34.339919 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334065 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334067 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334070 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334075 2575 flags.go:64] FLAG: --feature-gates="" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334079 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334082 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334085 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334088 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334090 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334093 2575 flags.go:64] FLAG: --help="false" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334096 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334099 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334102 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334105 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334109 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334112 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334115 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334118 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334121 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334124 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334126 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334129 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334132 2575 flags.go:64] FLAG: --kube-reserved="" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334134 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 21:04:34.340546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334137 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334140 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334143 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334146 2575 flags.go:64] FLAG: --lock-file="" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334148 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334151 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334154 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334159 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334163 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334165 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334168 2575 flags.go:64] FLAG: --logging-format="text" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334173 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334176 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334178 2575 flags.go:64] FLAG: --manifest-url="" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334181 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334192 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334195 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334203 2575 flags.go:64] FLAG: --max-pods="110" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334206 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334208 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334211 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334214 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334217 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334220 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334223 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 21:04:34.341134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334231 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334234 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334237 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334240 2575 flags.go:64] FLAG: --pod-cidr="" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334242 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334247 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334250 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334253 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334256 2575 flags.go:64] FLAG: --port="10250" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334259 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334262 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a136447d775f498a" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334265 2575 flags.go:64] FLAG: --qos-reserved="" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334268 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334271 2575 flags.go:64] FLAG: --register-node="true" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334273 2575 flags.go:64] FLAG: --register-with-taints="" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334277 2575 flags.go:64] FLAG: --registry-burst="10" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334281 2575 flags.go:64] FLAG: --registry-qps="5" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334284 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334287 2575 flags.go:64] FLAG: --reserved-memory="" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334292 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334295 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334298 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334301 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334303 2575 flags.go:64] FLAG: --runonce="false" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334306 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 21:04:34.341921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334309 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334311 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334314 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334317 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334320 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334323 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334326 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334329 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334332 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334335 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334337 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334340 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334343 2575 flags.go:64] FLAG: --system-cgroups="" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334346 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334351 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334353 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334356 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334361 2575 flags.go:64] FLAG: --tls-min-version="" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334364 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334366 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334369 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334372 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334376 2575 flags.go:64] FLAG: --v="2" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334384 2575 flags.go:64] FLAG: --version="false" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334390 2575 flags.go:64] FLAG: --vmodule="" Jul 27 21:04:34.342542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334393 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.334398 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334532 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334536 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334540 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334544 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334547 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334550 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334553 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334556 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334559 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334561 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334564 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334567 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334570 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334572 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334575 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334578 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334580 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334583 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:34.343157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334586 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334588 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334591 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334593 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334596 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334598 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334601 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334603 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334606 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334610 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334612 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334615 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334618 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334622 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334625 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334627 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334630 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334633 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334635 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334638 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:34.343637 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334640 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334643 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334645 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334648 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334650 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334653 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334655 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334657 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334660 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334662 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334665 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334667 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334670 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334673 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334675 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334677 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334680 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334682 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334685 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:34.344218 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334687 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334689 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334694 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334696 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334699 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334701 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334707 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334711 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334713 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334716 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334718 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334721 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334724 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334726 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334729 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334731 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334734 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334736 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334739 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:34.344683 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334741 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334744 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334747 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334749 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334751 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334754 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334756 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334776 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334780 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334783 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334786 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334789 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334792 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334795 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334797 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334801 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334803 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334806 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334809 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334813 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:34.345157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334816 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334819 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.334822 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.335462 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.342621 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.342640 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.344572 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.344580 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344639 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344644 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344647 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344651 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344654 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344657 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:34.345645 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344660 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344662 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344665 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344668 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344671 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344674 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344676 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344679 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344682 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344684 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344689 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344692 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344695 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344698 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344701 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344704 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344707 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344710 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344713 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344715 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:34.346020 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344718 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344721 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344723 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344727 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344730 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344733 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344736 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344738 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344741 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344743 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344746 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344748 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344751 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344753 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344756 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344758 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344761 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344763 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344765 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344768 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:34.346515 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344770 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344773 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344775 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344778 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344780 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344783 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344785 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344788 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344790 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344794 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344798 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344801 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344804 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344807 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344809 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344812 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344816 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344819 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344822 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:34.347010 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344826 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344829 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344832 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344835 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344838 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344841 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344844 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344846 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344849 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344852 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344855 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344857 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344859 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344862 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344864 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344867 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344869 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344872 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344886 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344888 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:34.347503 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344891 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344893 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344896 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344898 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344901 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344903 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344906 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344908 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344911 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344914 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344917 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344920 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344923 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.344926 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.344931 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 21:04:34.348116 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345043 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345047 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345050 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345053 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345057 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345060 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345063 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345065 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345068 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345070 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345073 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345075 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345078 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345080 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345083 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345085 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345088 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345090 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345093 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345095 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 21:04:34.348485 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345098 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345100 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345102 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345105 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345107 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345110 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345113 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345116 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345119 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345121 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345123 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345126 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345128 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345131 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345133 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345137 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345141 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345143 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345146 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 21:04:34.348987 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345149 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345152 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345154 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345157 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345160 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345162 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345165 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345168 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345170 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345173 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345175 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345178 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345180 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345183 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345185 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345188 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345190 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345193 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345196 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345200 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 21:04:34.349456 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345202 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345205 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345211 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345213 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345217 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345221 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345223 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345226 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345228 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345231 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345233 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345236 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345238 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345240 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345243 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345246 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345248 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345250 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345253 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 21:04:34.349960 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345255 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345258 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345260 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345262 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345265 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345268 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345270 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345272 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345275 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345277 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345280 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345283 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345286 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345289 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345292 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345294 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345297 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345300 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345302 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 21:04:34.350438 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345305 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 21:04:34.350951 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:34.345307 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 21:04:34.350951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.345312 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 21:04:34.350951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.345455 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 21:04:34.350951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.348956 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 21:04:34.350951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.350211 2575 server.go:1019] "Starting client certificate rotation" Jul 27 21:04:34.350951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.350340 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 21:04:34.350951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.350369 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 21:04:34.353629 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.353615 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 21:04:34.355176 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.355154 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 21:04:34.369555 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.369534 2575 log.go:25] "Validated CRI v1 runtime API" Jul 27 21:04:34.371495 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.371478 2575 log.go:25] "Validated CRI v1 image API" Jul 27 21:04:34.372852 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.372813 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 21:04:34.376111 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.376090 2575 fs.go:135] Filesystem UUIDs: map[0240df87-e4b9-4ad8-b79a-e7d119c54852:/dev/nvme0n1p4 5633b852-dcd6-4993-af67-98a68f32eb8e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 27 21:04:34.376178 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.376108 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 21:04:34.380575 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.380557 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 21:04:34.381025 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.380914 2575 manager.go:216] Machine: {Timestamp:2026-07-27 21:04:34.379689557 +0000 UTC m=+0.367256323 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102318 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2abaccb622f078c692cd1ce9707923 SystemUUID:ec2abacc-b622-f078-c692-cd1ce9707923 BootID:adbc0042-27e1-4155-b883-3da212790a4f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:74:80:58:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:74:80:58:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:7e:80:f6:a4:60 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 21:04:34.381025 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.381024 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 21:04:34.381116 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.381108 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 21:04:34.384492 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.384464 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 21:04:34.384625 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.384494 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 21:04:34.385196 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.385186 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 21:04:34.385227 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.385199 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 21:04:34.385227 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.385207 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 21:04:34.386143 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.386132 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 21:04:34.386942 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.386933 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 21:04:34.388660 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.388649 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 27 21:04:34.388784 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.388774 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 21:04:34.388825 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.388806 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 27 21:04:34.388825 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.388817 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 21:04:34.388906 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.388830 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 21:04:34.388906 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.388840 2575 kubelet.go:398] "Adding apiserver pod source" Jul 27 21:04:34.388906 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.388849 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 21:04:34.389288 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.389274 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 21:04:34.389321 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.389305 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 21:04:34.391378 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.391361 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 21:04:34.393741 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.393725 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 21:04:34.393812 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.393757 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 21:04:34.396064 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396048 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 21:04:34.396113 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396098 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 21:04:34.396113 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396111 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 21:04:34.396179 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396120 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 21:04:34.396179 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396133 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 21:04:34.396179 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396140 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 21:04:34.396179 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396154 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 21:04:34.396179 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396162 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 21:04:34.396179 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396174 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 21:04:34.396324 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396187 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 21:04:34.396324 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396207 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 21:04:34.396324 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.396216 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 21:04:34.397125 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.397108 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 21:04:34.397125 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.397123 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 21:04:34.398559 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.398531 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 21:04:34.398641 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.398535 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 21:04:34.400577 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.400561 2575 server.go:1268] "Started kubelet" Jul 27 21:04:34.400679 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.400636 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 21:04:34.400733 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.400661 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 21:04:34.400790 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.400759 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 21:04:34.401517 ip-10-0-139-153 systemd[1]: Started Kubernetes Kubelet. Jul 27 21:04:34.405461 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.405436 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 27 21:04:34.405551 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.405473 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 21:04:34.407892 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.407853 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 21:04:34.410527 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.410506 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzqmf" Jul 27 21:04:34.411050 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.411032 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 21:04:34.412147 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.410926 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-153.ec2.internal.18c641754f8be802 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-153.ec2.internal,UID:ip-10-0-139-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-153.ec2.internal,},FirstTimestamp:2026-07-27 21:04:34.400528386 +0000 UTC m=+0.388095151,LastTimestamp:2026-07-27 21:04:34.400528386 +0000 UTC m=+0.388095151,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-153.ec2.internal,}" Jul 27 21:04:34.412802 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.412788 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 21:04:34.412851 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.412840 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 21:04:34.412934 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.412917 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:34.413710 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.413691 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 21:04:34.413710 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.413694 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 21:04:34.413851 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.413717 2575 factory.go:55] Registering systemd factory Jul 27 21:04:34.413851 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.413735 2575 factory.go:223] Registration of the systemd container factory successfully Jul 27 21:04:34.413851 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.413720 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 21:04:34.413851 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.413824 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 27 21:04:34.413851 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.413832 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 27 21:04:34.414110 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.413953 2575 factory.go:153] Registering CRI-O factory Jul 27 21:04:34.414110 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.413967 2575 factory.go:223] Registration of the crio container factory successfully Jul 27 21:04:34.414110 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.414033 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 21:04:34.414110 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.414057 2575 factory.go:103] Registering Raw factory Jul 27 21:04:34.414110 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.414072 2575 manager.go:1196] Started watching for new ooms in manager Jul 27 21:04:34.415425 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.415402 2575 manager.go:349] Starting recovery of all containers Jul 27 21:04:34.416993 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.416838 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 21:04:34.416993 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.416871 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 21:04:34.417918 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.417868 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dzqmf" Jul 27 21:04:34.423917 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.423782 2575 manager.go:354] Recovery completed Jul 27 21:04:34.428195 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.428180 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:34.430005 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.429988 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:34.430067 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.430026 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:34.430067 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.430036 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:34.430602 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.430585 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 21:04:34.430602 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.430601 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 21:04:34.430684 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.430613 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:34.430726 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.430617 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 27 21:04:34.431326 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.431310 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:34.431402 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.431338 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:34.431402 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.431353 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:34.432413 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.432347 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-153.ec2.internal.18c64175514dbaf2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-153.ec2.internal,UID:ip-10-0-139-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-153.ec2.internal,},FirstTimestamp:2026-07-27 21:04:34.43000805 +0000 UTC m=+0.417574820,LastTimestamp:2026-07-27 21:04:34.43000805 +0000 UTC m=+0.417574820,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-153.ec2.internal,}" Jul 27 21:04:34.433103 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.433091 2575 policy_none.go:49] "None policy: Start" Jul 27 21:04:34.433145 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.433116 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 21:04:34.433145 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.433127 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 21:04:34.434253 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.434243 2575 policy_none.go:47] "Start" Jul 27 21:04:34.464534 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.464516 2575 manager.go:337] "Starting Device Plugin manager" Jul 27 21:04:34.464630 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.464549 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 21:04:34.464630 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.464562 2575 server.go:87] "Starting device plugin registration server" Jul 27 21:04:34.464812 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.464800 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 21:04:34.464852 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.464813 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 21:04:34.464970 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.464956 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 21:04:34.465051 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.465039 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 21:04:34.465103 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.465052 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 21:04:34.465620 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.465594 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 21:04:34.465681 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.465651 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:34.565109 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.565071 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:34.568247 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.568231 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:34.568331 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.568262 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:34.568331 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.568273 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:34.568331 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.568306 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.576448 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.576402 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.576448 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.576427 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-153.ec2.internal\": node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:34.596541 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.596513 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:34.618052 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.618018 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 21:04:34.619412 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.619390 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 21:04:34.619496 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.619425 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 21:04:34.619496 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.619444 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 21:04:34.619496 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.619479 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 21:04:34.625774 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.625754 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 21:04:34.697440 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.697391 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:34.719842 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.719814 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal"] Jul 27 21:04:34.719953 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.719937 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:34.722561 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.722545 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:34.722649 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.722574 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:34.722649 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.722584 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:34.724094 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.724081 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:34.724200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.724183 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.724255 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.724215 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:34.724827 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.724808 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:34.724951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.724812 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:34.724951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.724863 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:34.724951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.724840 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:34.724951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.724900 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:34.724951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.724915 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:34.726393 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.726379 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.726439 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.726406 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 21:04:34.727075 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.727060 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientMemory" Jul 27 21:04:34.727137 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.727089 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 21:04:34.727137 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.727103 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeHasSufficientPID" Jul 27 21:04:34.761660 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.761632 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-153.ec2.internal\" not found" node="ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.765231 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.765215 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-153.ec2.internal\" not found" node="ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.798421 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.798399 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:34.815783 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.815761 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be484760452c4488384d3c6b0a59fc4e-config\") pod \"kube-apiserver-proxy-ip-10-0-139-153.ec2.internal\" (UID: \"be484760452c4488384d3c6b0a59fc4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.815869 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.815794 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a694ad3c82de933979ec656930c63e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8a694ad3c82de933979ec656930c63e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.815869 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.815812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a694ad3c82de933979ec656930c63e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8a694ad3c82de933979ec656930c63e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.899522 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:34.899451 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:34.916853 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.916828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a694ad3c82de933979ec656930c63e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8a694ad3c82de933979ec656930c63e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.916926 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.916859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be484760452c4488384d3c6b0a59fc4e-config\") pod \"kube-apiserver-proxy-ip-10-0-139-153.ec2.internal\" (UID: \"be484760452c4488384d3c6b0a59fc4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.916926 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.916894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a694ad3c82de933979ec656930c63e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8a694ad3c82de933979ec656930c63e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.917024 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.916943 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a694ad3c82de933979ec656930c63e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8a694ad3c82de933979ec656930c63e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.917024 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.916974 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/be484760452c4488384d3c6b0a59fc4e-config\") pod \"kube-apiserver-proxy-ip-10-0-139-153.ec2.internal\" (UID: \"be484760452c4488384d3c6b0a59fc4e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 27 21:04:34.917024 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:34.916943 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a694ad3c82de933979ec656930c63e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal\" (UID: \"8a694ad3c82de933979ec656930c63e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 27 21:04:36.044563 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:36.044542 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:36.109101 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.109072 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 27 21:04:36.113851 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.113782 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 27 21:04:36.145391 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:36.145359 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:36.245885 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:36.245806 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:36.346381 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:36.346349 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:36.394835 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.394807 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 21:04:36.395335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.394951 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 21:04:36.439793 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.439758 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 21:04:36.447159 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:36.447138 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:36.467648 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.467610 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 20:59:35 +0000 UTC" deadline="2028-05-02 12:35:36.906981898 +0000 UTC" Jul 27 21:04:36.467648 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.467637 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15471h31m0.439347428s" Jul 27 21:04:36.547864 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:36.547778 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:36.596380 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.596347 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 21:04:36.647899 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:36.647868 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:36.664157 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:36.664126 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe484760452c4488384d3c6b0a59fc4e.slice/crio-c0d83cef2be8d310c72df0e2db4f8362d7d50f23e972712625c5480e83036bbe WatchSource:0}: Error finding container c0d83cef2be8d310c72df0e2db4f8362d7d50f23e972712625c5480e83036bbe: Status 404 returned error can't find the container with id c0d83cef2be8d310c72df0e2db4f8362d7d50f23e972712625c5480e83036bbe Jul 27 21:04:36.664667 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:36.664645 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a694ad3c82de933979ec656930c63e0.slice/crio-1b0cf2e5c87044804813ab1b7a4b3f0e3d262e0fe3fb35c78573c733ba82c10a WatchSource:0}: Error finding container 1b0cf2e5c87044804813ab1b7a4b3f0e3d262e0fe3fb35c78573c733ba82c10a: Status 404 returned error can't find the container with id 1b0cf2e5c87044804813ab1b7a4b3f0e3d262e0fe3fb35c78573c733ba82c10a Jul 27 21:04:36.670328 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.670297 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 21:04:36.749017 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:36.748971 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:36.849634 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:36.849540 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-153.ec2.internal\" not found" Jul 27 21:04:36.900655 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.900625 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 21:04:36.958045 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.958019 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" Jul 27 21:04:36.971613 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.971585 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 21:04:36.972781 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.972768 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" Jul 27 21:04:36.981921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:36.981898 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 21:04:37.433995 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.433965 2575 apiserver.go:52] "Watching apiserver" Jul 27 21:04:37.444993 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.444803 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 21:04:37.445219 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.445186 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-9lvcm","openshift-dns/node-resolver-52fqc","openshift-image-registry/node-ca-thftq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-jnlqv","kube-system/global-pull-secret-syncer-7sbtn","openshift-multus/multus-additional-cni-plugins-pwrdj","openshift-multus/multus-w86wc","openshift-multus/network-metrics-daemon-fk22f","openshift-network-diagnostics/network-check-target-26hcs","openshift-network-operator/iptables-alerter-65gz9","kube-system/konnectivity-agent-sw9mr","kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk"] Jul 27 21:04:37.447795 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.447775 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:37.447892 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.447866 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:37.448778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.448760 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.450374 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.450353 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.451668 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.451651 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8nn7m\"" Jul 27 21:04:37.451759 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.451684 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 21:04:37.451759 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.451729 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 21:04:37.452035 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.452014 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 21:04:37.452954 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.452932 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.454932 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.454913 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 21:04:37.455023 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.454931 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 21:04:37.455023 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.454990 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.455153 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.455137 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 21:04:37.455311 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.455282 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rc7bb\"" Jul 27 21:04:37.455652 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.455631 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 21:04:37.456187 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.455875 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lpvq8\"" Jul 27 21:04:37.456187 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.455922 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:37.456187 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.455942 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 21:04:37.456187 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.455982 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:37.456187 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.456036 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 21:04:37.457612 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.457596 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 21:04:37.457894 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.457860 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:37.457977 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.457942 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:37.458902 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.458885 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 21:04:37.460474 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.460034 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.460474 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.460391 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 21:04:37.460628 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.460490 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 21:04:37.460863 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.460842 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 21:04:37.462324 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.461986 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:04:37.462324 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.462031 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 21:04:37.462324 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.461983 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2gtb2\"" Jul 27 21:04:37.463631 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.463311 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.463793 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.463777 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 21:04:37.463869 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.463828 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 21:04:37.464159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.464141 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 21:04:37.464235 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.464202 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 21:04:37.464292 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.464245 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xp7r2\"" Jul 27 21:04:37.465217 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.465200 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 21:04:37.465401 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.465385 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 21:04:37.465588 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.465574 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7mcgk\"" Jul 27 21:04:37.466103 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.465882 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.466769 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.466725 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 21:04:37.467479 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.467102 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 21:04:37.467479 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.467130 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.467479 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.467223 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 21:04:37.467479 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.467132 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b72jn\"" Jul 27 21:04:37.469580 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469564 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 21:04:37.469690 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469572 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 21:04:37.469825 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469761 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5a52839-770b-4575-9afa-fdc879260cbd-host-slash\") pod \"iptables-alerter-65gz9\" (UID: \"e5a52839-770b-4575-9afa-fdc879260cbd\") " pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.469825 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-node-log\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.469825 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469800 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lfffh\"" Jul 27 21:04:37.469825 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469814 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-log-socket\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.470044 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-cni-netd\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.470044 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-socket-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.470044 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-var-lib-kubelet\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470044 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469949 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-hostroot\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470044 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.469987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5a52839-770b-4575-9afa-fdc879260cbd-iptables-alerter-script\") pod \"iptables-alerter-65gz9\" (UID: \"e5a52839-770b-4575-9afa-fdc879260cbd\") " pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.470044 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23060fe1-e58e-47b8-b213-1e259ef3b79c-serviceca\") pod \"node-ca-thftq\" (UID: \"23060fe1-e58e-47b8-b213-1e259ef3b79c\") " pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.470335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fpwt\" (UniqueName: \"kubernetes.io/projected/23060fe1-e58e-47b8-b213-1e259ef3b79c-kube-api-access-8fpwt\") pod \"node-ca-thftq\" (UID: \"23060fe1-e58e-47b8-b213-1e259ef3b79c\") " pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.470335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.470335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-device-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.470335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470172 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-955tg\" (UniqueName: \"kubernetes.io/projected/4d185361-644f-4d31-9f5f-8913d2b7b173-kube-api-access-955tg\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.470335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-var-lib-cni-bin\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470283 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-slash\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.470335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-kubelet-config\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:37.470335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-cnibin\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff9kb\" (UniqueName: \"kubernetes.io/projected/e5a52839-770b-4575-9afa-fdc879260cbd-kube-api-access-ff9kb\") pod \"iptables-alerter-65gz9\" (UID: \"e5a52839-770b-4575-9afa-fdc879260cbd\") " pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470390 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-run-openvswitch\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470439 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-run-ovn\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62rwk\" (UniqueName: \"kubernetes.io/projected/72422086-5752-4ba5-8c13-0521ac39e0f3-kube-api-access-62rwk\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470491 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-run-netns\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-os-release\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06d51315-6389-42de-8ac4-28d350e61677-cni-binary-copy\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-run-multus-certs\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470586 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-etc-kubernetes\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470609 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-system-cni-dir\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.470729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.470634 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-var-lib-cni-multus\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.471311 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.471294 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-frqgl\"" Jul 27 21:04:37.472007 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.471981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6tg7\" (UniqueName: \"kubernetes.io/projected/06d51315-6389-42de-8ac4-28d350e61677-kube-api-access-r6tg7\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.472100 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472022 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 21:04:37.472165 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-dbus\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:37.472165 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472155 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 21:04:37.472270 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:37.472270 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-run-k8s-cni-cncf-io\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.472355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06d51315-6389-42de-8ac4-28d350e61677-multus-daemon-config\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.472355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-var-lib-openvswitch\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.472515 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472487 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-etc-openvswitch\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.472588 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-multus-cni-dir\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.472588 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472567 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-multus-conf-dir\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.472682 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472625 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-run-netns\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.472819 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-cni-bin\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.472867 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72422086-5752-4ba5-8c13-0521ac39e0f3-ovnkube-script-lib\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.472934 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-multus-socket-dir-parent\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.472999 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.472969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.473048 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473018 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:37.473095 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473070 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72422086-5752-4ba5-8c13-0521ac39e0f3-env-overrides\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.473143 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473127 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:37.473190 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473177 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-registration-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-etc-selinux\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-systemd-units\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-sys-fs\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-kubelet\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wkr2\" (UniqueName: \"kubernetes.io/projected/56e54f19-f7c4-4828-9333-7f61dacd4781-kube-api-access-4wkr2\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473498 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23060fe1-e58e-47b8-b213-1e259ef3b79c-host\") pod \"node-ca-thftq\" (UID: \"23060fe1-e58e-47b8-b213-1e259ef3b79c\") " pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-run-systemd\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72422086-5752-4ba5-8c13-0521ac39e0f3-ovnkube-config\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.474346 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.473614 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72422086-5752-4ba5-8c13-0521ac39e0f3-ovn-node-metrics-cert\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.475032 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.475008 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 21:04:37.500632 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.500605 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nsdzr" Jul 27 21:04:37.512944 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.512914 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nsdzr" Jul 27 21:04:37.560279 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.560246 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 21:04:37.574187 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-multus-socket-dir-parent\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.574369 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.574369 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:37.574369 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6a58687-1aed-4540-ba0e-c4f32ada0330-hosts-file\") pod \"node-resolver-52fqc\" (UID: \"f6a58687-1aed-4540-ba0e-c4f32ada0330\") " pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.574369 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f1eb411-3b84-4744-9381-c1dfad2b10b5-konnectivity-ca\") pod \"konnectivity-agent-sw9mr\" (UID: \"3f1eb411-3b84-4744-9381-c1dfad2b10b5\") " pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:04:37.574369 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c240878-122d-4ffe-85bb-00f3ffcf15c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.574369 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574314 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-multus-socket-dir-parent\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.574369 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574321 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72422086-5752-4ba5-8c13-0521ac39e0f3-env-overrides\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574375 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-sysctl-conf\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-var-lib-kubelet\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-registration-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-etc-selinux\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574532 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-systemd-units\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-sys-fs\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-kubelet\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574640 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-sysctl-d\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574681 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/157f3110-39dc-44b2-8148-5171965fbc8a-etc-tuned\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574713 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wkr2\" (UniqueName: \"kubernetes.io/projected/56e54f19-f7c4-4828-9333-7f61dacd4781-kube-api-access-4wkr2\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23060fe1-e58e-47b8-b213-1e259ef3b79c-host\") pod \"node-ca-thftq\" (UID: \"23060fe1-e58e-47b8-b213-1e259ef3b79c\") " pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.574797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574798 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-run-systemd\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72422086-5752-4ba5-8c13-0521ac39e0f3-ovnkube-config\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574851 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72422086-5752-4ba5-8c13-0521ac39e0f3-ovn-node-metrics-cert\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574876 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-kubernetes\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-systemd\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574919 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/72422086-5752-4ba5-8c13-0521ac39e0f3-env-overrides\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.574924 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-run\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-lib-modules\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575037 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/157f3110-39dc-44b2-8148-5171965fbc8a-tmp\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58q2x\" (UniqueName: \"kubernetes.io/projected/157f3110-39dc-44b2-8148-5171965fbc8a-kube-api-access-58q2x\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5a52839-770b-4575-9afa-fdc879260cbd-host-slash\") pod \"iptables-alerter-65gz9\" (UID: \"e5a52839-770b-4575-9afa-fdc879260cbd\") " pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575129 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-node-log\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575155 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-log-socket\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-cni-netd\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575205 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wfp8\" (UniqueName: \"kubernetes.io/projected/f6a58687-1aed-4540-ba0e-c4f32ada0330-kube-api-access-4wfp8\") pod \"node-resolver-52fqc\" (UID: \"f6a58687-1aed-4540-ba0e-c4f32ada0330\") " pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575231 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-os-release\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-socket-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.575468 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575266 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-registration-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575282 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-system-cni-dir\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575357 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-var-lib-kubelet\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575358 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-etc-selinux\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-hostroot\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575413 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-var-lib-kubelet\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5a52839-770b-4575-9afa-fdc879260cbd-iptables-alerter-script\") pod \"iptables-alerter-65gz9\" (UID: \"e5a52839-770b-4575-9afa-fdc879260cbd\") " pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575478 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23060fe1-e58e-47b8-b213-1e259ef3b79c-serviceca\") pod \"node-ca-thftq\" (UID: \"23060fe1-e58e-47b8-b213-1e259ef3b79c\") " pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575493 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23060fe1-e58e-47b8-b213-1e259ef3b79c-host\") pod \"node-ca-thftq\" (UID: \"23060fe1-e58e-47b8-b213-1e259ef3b79c\") " pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575506 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fpwt\" (UniqueName: \"kubernetes.io/projected/23060fe1-e58e-47b8-b213-1e259ef3b79c-kube-api-access-8fpwt\") pod \"node-ca-thftq\" (UID: \"23060fe1-e58e-47b8-b213-1e259ef3b79c\") " pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575551 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-run-systemd\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-device-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575590 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-hostroot\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-955tg\" (UniqueName: \"kubernetes.io/projected/4d185361-644f-4d31-9f5f-8913d2b7b173-kube-api-access-955tg\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575619 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-var-lib-cni-bin\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.576278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-slash\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575669 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-kubelet-config\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575679 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-systemd-units\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575702 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6a58687-1aed-4540-ba0e-c4f32ada0330-tmp-dir\") pod \"node-resolver-52fqc\" (UID: \"f6a58687-1aed-4540-ba0e-c4f32ada0330\") " pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-modprobe-d\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575733 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-sys-fs\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575752 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-sysconfig\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-cnibin\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575813 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-run-ovn-kubernetes\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff9kb\" (UniqueName: \"kubernetes.io/projected/e5a52839-770b-4575-9afa-fdc879260cbd-kube-api-access-ff9kb\") pod \"iptables-alerter-65gz9\" (UID: \"e5a52839-770b-4575-9afa-fdc879260cbd\") " pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-run-openvswitch\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575858 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575878 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-slash\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575779 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-kubelet\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575906 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/72422086-5752-4ba5-8c13-0521ac39e0f3-ovnkube-config\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575920 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-run-ovn\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575934 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-device-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575957 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-run-openvswitch\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575966 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575976 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-cnibin\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575999 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-run-ovn\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.575998 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62rwk\" (UniqueName: \"kubernetes.io/projected/72422086-5752-4ba5-8c13-0521ac39e0f3-kube-api-access-62rwk\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-sys\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576056 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-var-lib-cni-bin\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576059 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c240878-122d-4ffe-85bb-00f3ffcf15c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576093 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-node-log\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdlck\" (UniqueName: \"kubernetes.io/projected/3c240878-122d-4ffe-85bb-00f3ffcf15c9-kube-api-access-zdlck\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-run-netns\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576178 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-os-release\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576188 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-cni-netd\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576205 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06d51315-6389-42de-8ac4-28d350e61677-cni-binary-copy\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576154 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5a52839-770b-4575-9afa-fdc879260cbd-host-slash\") pod \"iptables-alerter-65gz9\" (UID: \"e5a52839-770b-4575-9afa-fdc879260cbd\") " pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576251 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-kubelet-config\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576262 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-log-socket\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.576320 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:37.577940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576369 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-run-netns\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.576401 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret podName:a22b8bbf-dcd5-4856-ba68-ee02abe770b7 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:38.076362748 +0000 UTC m=+3.019383757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret") pod "global-pull-secret-syncer-7sbtn" (UID: "a22b8bbf-dcd5-4856-ba68-ee02abe770b7") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-run-multus-certs\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576464 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-etc-kubernetes\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576476 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-socket-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-host\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576536 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-cnibin\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576555 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-os-release\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576557 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-system-cni-dir\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576557 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5a52839-770b-4575-9afa-fdc879260cbd-iptables-alerter-script\") pod \"iptables-alerter-65gz9\" (UID: \"e5a52839-770b-4575-9afa-fdc879260cbd\") " pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-var-lib-cni-multus\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6tg7\" (UniqueName: \"kubernetes.io/projected/06d51315-6389-42de-8ac4-28d350e61677-kube-api-access-r6tg7\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576614 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d185361-644f-4d31-9f5f-8913d2b7b173-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-dbus\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576659 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-var-lib-cni-multus\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576668 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/23060fe1-e58e-47b8-b213-1e259ef3b79c-serviceca\") pod \"node-ca-thftq\" (UID: \"23060fe1-e58e-47b8-b213-1e259ef3b79c\") " pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.578753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576684 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-run-k8s-cni-cncf-io\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576717 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-system-cni-dir\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576732 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-run-k8s-cni-cncf-io\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576751 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-etc-kubernetes\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06d51315-6389-42de-8ac4-28d350e61677-multus-daemon-config\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576879 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-host-run-multus-certs\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.576967 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.576974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-var-lib-openvswitch\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577005 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-etc-openvswitch\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f1eb411-3b84-4744-9381-c1dfad2b10b5-agent-certs\") pod \"konnectivity-agent-sw9mr\" (UID: \"3f1eb411-3b84-4744-9381-c1dfad2b10b5\") " pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577052 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-var-lib-openvswitch\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c240878-122d-4ffe-85bb-00f3ffcf15c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-multus-cni-dir\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577111 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-multus-conf-dir\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577134 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-run-netns\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577138 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-etc-openvswitch\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-dbus\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577158 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-cni-bin\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.579606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06d51315-6389-42de-8ac4-28d350e61677-cni-binary-copy\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.580122 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.577178 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs podName:56e54f19-f7c4-4828-9333-7f61dacd4781 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:38.077160322 +0000 UTC m=+3.020181329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs") pod "network-metrics-daemon-fk22f" (UID: "56e54f19-f7c4-4828-9333-7f61dacd4781") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:37.580122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577201 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-cni-bin\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.580122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577240 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-multus-conf-dir\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.580122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577274 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/72422086-5752-4ba5-8c13-0521ac39e0f3-host-run-netns\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.580122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577282 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72422086-5752-4ba5-8c13-0521ac39e0f3-ovnkube-script-lib\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.580122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577310 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d51315-6389-42de-8ac4-28d350e61677-multus-cni-dir\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.580122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577448 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06d51315-6389-42de-8ac4-28d350e61677-multus-daemon-config\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.580122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.577930 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/72422086-5752-4ba5-8c13-0521ac39e0f3-ovnkube-script-lib\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.580122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.579472 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/72422086-5752-4ba5-8c13-0521ac39e0f3-ovn-node-metrics-cert\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.594115 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.594089 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff9kb\" (UniqueName: \"kubernetes.io/projected/e5a52839-770b-4575-9afa-fdc879260cbd-kube-api-access-ff9kb\") pod \"iptables-alerter-65gz9\" (UID: \"e5a52839-770b-4575-9afa-fdc879260cbd\") " pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.598551 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.598526 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:37.598702 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.598568 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:37.598702 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.598583 2575 projected.go:196] Error preparing data for projected volume kube-api-access-mc95z for pod openshift-network-diagnostics/network-check-target-26hcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:37.598702 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:37.598652 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z podName:29b4c36b-f1cc-4e94-8f69-ba1141da6f41 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:38.098634041 +0000 UTC m=+3.041655053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mc95z" (UniqueName: "kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z") pod "network-check-target-26hcs" (UID: "29b4c36b-f1cc-4e94-8f69-ba1141da6f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:37.599344 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.599318 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wkr2\" (UniqueName: \"kubernetes.io/projected/56e54f19-f7c4-4828-9333-7f61dacd4781-kube-api-access-4wkr2\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:37.600720 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.600698 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fpwt\" (UniqueName: \"kubernetes.io/projected/23060fe1-e58e-47b8-b213-1e259ef3b79c-kube-api-access-8fpwt\") pod \"node-ca-thftq\" (UID: \"23060fe1-e58e-47b8-b213-1e259ef3b79c\") " pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.601192 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.601175 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-955tg\" (UniqueName: \"kubernetes.io/projected/4d185361-644f-4d31-9f5f-8913d2b7b173-kube-api-access-955tg\") pod \"aws-ebs-csi-driver-node-jckkk\" (UID: \"4d185361-644f-4d31-9f5f-8913d2b7b173\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.601974 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.601945 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6tg7\" (UniqueName: \"kubernetes.io/projected/06d51315-6389-42de-8ac4-28d350e61677-kube-api-access-r6tg7\") pod \"multus-w86wc\" (UID: \"06d51315-6389-42de-8ac4-28d350e61677\") " pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.602075 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.602024 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62rwk\" (UniqueName: \"kubernetes.io/projected/72422086-5752-4ba5-8c13-0521ac39e0f3-kube-api-access-62rwk\") pod \"ovnkube-node-jnlqv\" (UID: \"72422086-5752-4ba5-8c13-0521ac39e0f3\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.672616 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.672545 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" event={"ID":"8a694ad3c82de933979ec656930c63e0","Type":"ContainerStarted","Data":"1b0cf2e5c87044804813ab1b7a4b3f0e3d262e0fe3fb35c78573c733ba82c10a"} Jul 27 21:04:37.673712 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.673681 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" event={"ID":"be484760452c4488384d3c6b0a59fc4e","Type":"ContainerStarted","Data":"c0d83cef2be8d310c72df0e2db4f8362d7d50f23e972712625c5480e83036bbe"} Jul 27 21:04:37.677999 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.677972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-os-release\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678132 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-system-cni-dir\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678132 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678041 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678132 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678074 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6a58687-1aed-4540-ba0e-c4f32ada0330-tmp-dir\") pod \"node-resolver-52fqc\" (UID: \"f6a58687-1aed-4540-ba0e-c4f32ada0330\") " pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.678132 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678076 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-os-release\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678132 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678097 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-modprobe-d\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.678132 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-sysconfig\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678125 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-system-cni-dir\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678147 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-sys\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678172 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c240878-122d-4ffe-85bb-00f3ffcf15c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdlck\" (UniqueName: \"kubernetes.io/projected/3c240878-122d-4ffe-85bb-00f3ffcf15c9-kube-api-access-zdlck\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678224 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-host\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678226 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-sysconfig\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678248 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-cnibin\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-modprobe-d\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678270 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678307 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f1eb411-3b84-4744-9381-c1dfad2b10b5-agent-certs\") pod \"konnectivity-agent-sw9mr\" (UID: \"3f1eb411-3b84-4744-9381-c1dfad2b10b5\") " pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c240878-122d-4ffe-85bb-00f3ffcf15c9-cnibin\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678336 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c240878-122d-4ffe-85bb-00f3ffcf15c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6a58687-1aed-4540-ba0e-c4f32ada0330-hosts-file\") pod \"node-resolver-52fqc\" (UID: \"f6a58687-1aed-4540-ba0e-c4f32ada0330\") " pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.678410 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678405 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f1eb411-3b84-4744-9381-c1dfad2b10b5-konnectivity-ca\") pod \"konnectivity-agent-sw9mr\" (UID: \"3f1eb411-3b84-4744-9381-c1dfad2b10b5\") " pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678413 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6a58687-1aed-4540-ba0e-c4f32ada0330-tmp-dir\") pod \"node-resolver-52fqc\" (UID: \"f6a58687-1aed-4540-ba0e-c4f32ada0330\") " pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678451 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c240878-122d-4ffe-85bb-00f3ffcf15c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-sysctl-conf\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678499 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-var-lib-kubelet\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678522 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-sys\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678538 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-sysctl-d\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/157f3110-39dc-44b2-8148-5171965fbc8a-etc-tuned\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678591 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f6a58687-1aed-4540-ba0e-c4f32ada0330-hosts-file\") pod \"node-resolver-52fqc\" (UID: \"f6a58687-1aed-4540-ba0e-c4f32ada0330\") " pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678610 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-kubernetes\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678634 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-systemd\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678658 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-run\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-lib-modules\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678698 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-sysctl-conf\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678702 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/157f3110-39dc-44b2-8148-5171965fbc8a-tmp\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678738 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58q2x\" (UniqueName: \"kubernetes.io/projected/157f3110-39dc-44b2-8148-5171965fbc8a-kube-api-access-58q2x\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wfp8\" (UniqueName: \"kubernetes.io/projected/f6a58687-1aed-4540-ba0e-c4f32ada0330-kube-api-access-4wfp8\") pod \"node-resolver-52fqc\" (UID: \"f6a58687-1aed-4540-ba0e-c4f32ada0330\") " pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678764 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-var-lib-kubelet\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.679063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-kubernetes\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.680200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678837 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-systemd\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.680200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678897 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-etc-sysctl-d\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.680200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678940 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-lib-modules\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.680200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.678993 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-run\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.680200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.679093 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/157f3110-39dc-44b2-8148-5171965fbc8a-host\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.680200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.679777 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3c240878-122d-4ffe-85bb-00f3ffcf15c9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.680200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.679838 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f1eb411-3b84-4744-9381-c1dfad2b10b5-konnectivity-ca\") pod \"konnectivity-agent-sw9mr\" (UID: \"3f1eb411-3b84-4744-9381-c1dfad2b10b5\") " pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:04:37.680200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.679933 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3c240878-122d-4ffe-85bb-00f3ffcf15c9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.680618 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.680261 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c240878-122d-4ffe-85bb-00f3ffcf15c9-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.681186 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.681161 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/157f3110-39dc-44b2-8148-5171965fbc8a-etc-tuned\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.681288 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.681269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/157f3110-39dc-44b2-8148-5171965fbc8a-tmp\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.681770 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.681749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f1eb411-3b84-4744-9381-c1dfad2b10b5-agent-certs\") pod \"konnectivity-agent-sw9mr\" (UID: \"3f1eb411-3b84-4744-9381-c1dfad2b10b5\") " pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:04:37.694647 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.694571 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wfp8\" (UniqueName: \"kubernetes.io/projected/f6a58687-1aed-4540-ba0e-c4f32ada0330-kube-api-access-4wfp8\") pod \"node-resolver-52fqc\" (UID: \"f6a58687-1aed-4540-ba0e-c4f32ada0330\") " pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.697466 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.697417 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdlck\" (UniqueName: \"kubernetes.io/projected/3c240878-122d-4ffe-85bb-00f3ffcf15c9-kube-api-access-zdlck\") pod \"multus-additional-cni-plugins-pwrdj\" (UID: \"3c240878-122d-4ffe-85bb-00f3ffcf15c9\") " pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.698128 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.698109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58q2x\" (UniqueName: \"kubernetes.io/projected/157f3110-39dc-44b2-8148-5171965fbc8a-kube-api-access-58q2x\") pod \"tuned-9lvcm\" (UID: \"157f3110-39dc-44b2-8148-5171965fbc8a\") " pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.763694 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.763655 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-65gz9" Jul 27 21:04:37.773602 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.773576 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-thftq" Jul 27 21:04:37.782818 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.782787 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" Jul 27 21:04:37.788837 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.788812 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:04:37.795533 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.795511 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w86wc" Jul 27 21:04:37.803220 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.803197 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:04:37.809867 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.809845 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" Jul 27 21:04:37.818340 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.818321 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" Jul 27 21:04:37.824003 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.823976 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-52fqc" Jul 27 21:04:37.957319 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:37.957253 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 21:04:38.081721 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.081686 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:38.081882 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.081736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:38.081882 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:38.081837 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:38.081978 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:38.081910 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs podName:56e54f19-f7c4-4828-9333-7f61dacd4781 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:39.081889107 +0000 UTC m=+4.024910118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs") pod "network-metrics-daemon-fk22f" (UID: "56e54f19-f7c4-4828-9333-7f61dacd4781") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:38.081978 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:38.081908 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:38.081978 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:38.081974 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret podName:a22b8bbf-dcd5-4856-ba68-ee02abe770b7 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:39.081957655 +0000 UTC m=+4.024978682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret") pod "global-pull-secret-syncer-7sbtn" (UID: "a22b8bbf-dcd5-4856-ba68-ee02abe770b7") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:38.182152 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.182116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:38.182355 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:38.182329 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:38.182435 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:38.182367 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:38.182435 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:38.182381 2575 projected.go:196] Error preparing data for projected volume kube-api-access-mc95z for pod openshift-network-diagnostics/network-check-target-26hcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:38.182512 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:38.182475 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z podName:29b4c36b-f1cc-4e94-8f69-ba1141da6f41 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:39.182449885 +0000 UTC m=+4.125470893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mc95z" (UniqueName: "kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z") pod "network-check-target-26hcs" (UID: "29b4c36b-f1cc-4e94-8f69-ba1141da6f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:38.515616 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.515510 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:59:37 +0000 UTC" deadline="2028-03-12 22:56:57.829283494 +0000 UTC" Jul 27 21:04:38.515616 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.515556 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14257h52m19.31373372s" Jul 27 21:04:38.598927 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:38.598829 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d51315_6389_42de_8ac4_28d350e61677.slice/crio-87faab83c828d34e2d9f4e7b770fe55459895f9cba99e9274cf64818c7093862 WatchSource:0}: Error finding container 87faab83c828d34e2d9f4e7b770fe55459895f9cba99e9274cf64818c7093862: Status 404 returned error can't find the container with id 87faab83c828d34e2d9f4e7b770fe55459895f9cba99e9274cf64818c7093862 Jul 27 21:04:38.600660 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:38.600566 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1eb411_3b84_4744_9381_c1dfad2b10b5.slice/crio-64f48127b9ede5e72aa06ef4b79344598763d2026a41ec1d943fd6c2e2bdac02 WatchSource:0}: Error finding container 64f48127b9ede5e72aa06ef4b79344598763d2026a41ec1d943fd6c2e2bdac02: Status 404 returned error can't find the container with id 64f48127b9ede5e72aa06ef4b79344598763d2026a41ec1d943fd6c2e2bdac02 Jul 27 21:04:38.604943 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:38.604920 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a52839_770b_4575_9afa_fdc879260cbd.slice/crio-efa9e914d40b4605ee7c4cda6b73c9cc5dcb4b92599582f1ca638e64481e6dc2 WatchSource:0}: Error finding container efa9e914d40b4605ee7c4cda6b73c9cc5dcb4b92599582f1ca638e64481e6dc2: Status 404 returned error can't find the container with id efa9e914d40b4605ee7c4cda6b73c9cc5dcb4b92599582f1ca638e64481e6dc2 Jul 27 21:04:38.606597 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:38.606560 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157f3110_39dc_44b2_8148_5171965fbc8a.slice/crio-bf90a4337ee04b7783603f4aeef291eb2a565d8b42f2ef80fc9785f1a0c02a62 WatchSource:0}: Error finding container bf90a4337ee04b7783603f4aeef291eb2a565d8b42f2ef80fc9785f1a0c02a62: Status 404 returned error can't find the container with id bf90a4337ee04b7783603f4aeef291eb2a565d8b42f2ef80fc9785f1a0c02a62 Jul 27 21:04:38.608398 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:38.608379 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c240878_122d_4ffe_85bb_00f3ffcf15c9.slice/crio-b7d49f9cdbf4c8683e9c77c17bd1b0b53e8dbdf0080a8008bffac27ea9e9fd0f WatchSource:0}: Error finding container b7d49f9cdbf4c8683e9c77c17bd1b0b53e8dbdf0080a8008bffac27ea9e9fd0f: Status 404 returned error can't find the container with id b7d49f9cdbf4c8683e9c77c17bd1b0b53e8dbdf0080a8008bffac27ea9e9fd0f Jul 27 21:04:38.609466 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:04:38.609448 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72422086_5752_4ba5_8c13_0521ac39e0f3.slice/crio-7b0ea8976649dae61883bb8e25ac36ec7c38e1b00a23ec0d92508db6898f889e WatchSource:0}: Error finding container 7b0ea8976649dae61883bb8e25ac36ec7c38e1b00a23ec0d92508db6898f889e: Status 404 returned error can't find the container with id 7b0ea8976649dae61883bb8e25ac36ec7c38e1b00a23ec0d92508db6898f889e Jul 27 21:04:38.664305 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.664145 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:38.664444 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:38.664405 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:38.676475 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.676389 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52fqc" event={"ID":"f6a58687-1aed-4540-ba0e-c4f32ada0330","Type":"ContainerStarted","Data":"a867ca66631f1cef09c0992e10c7602aa52ac2d448ad6ff7d1dbcba8d0873bc8"} Jul 27 21:04:38.677618 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.677596 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" event={"ID":"4d185361-644f-4d31-9f5f-8913d2b7b173","Type":"ContainerStarted","Data":"ddd1e797177acea8d0f918d4e3f7c83ae1b2b083170b1b776812ba64896279ba"} Jul 27 21:04:38.678781 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.678760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-thftq" event={"ID":"23060fe1-e58e-47b8-b213-1e259ef3b79c","Type":"ContainerStarted","Data":"b972eaa9bf481473f7136aae0566ddfbc8d366ad665e1ff43e6862625784791f"} Jul 27 21:04:38.679868 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.679845 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerStarted","Data":"7b0ea8976649dae61883bb8e25ac36ec7c38e1b00a23ec0d92508db6898f889e"} Jul 27 21:04:38.681539 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.681521 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" event={"ID":"3c240878-122d-4ffe-85bb-00f3ffcf15c9","Type":"ContainerStarted","Data":"b7d49f9cdbf4c8683e9c77c17bd1b0b53e8dbdf0080a8008bffac27ea9e9fd0f"} Jul 27 21:04:38.682669 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.682650 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-65gz9" event={"ID":"e5a52839-770b-4575-9afa-fdc879260cbd","Type":"ContainerStarted","Data":"efa9e914d40b4605ee7c4cda6b73c9cc5dcb4b92599582f1ca638e64481e6dc2"} Jul 27 21:04:38.683918 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.683883 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" event={"ID":"157f3110-39dc-44b2-8148-5171965fbc8a","Type":"ContainerStarted","Data":"bf90a4337ee04b7783603f4aeef291eb2a565d8b42f2ef80fc9785f1a0c02a62"} Jul 27 21:04:38.684986 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.684963 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sw9mr" event={"ID":"3f1eb411-3b84-4744-9381-c1dfad2b10b5","Type":"ContainerStarted","Data":"64f48127b9ede5e72aa06ef4b79344598763d2026a41ec1d943fd6c2e2bdac02"} Jul 27 21:04:38.687885 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:38.687857 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w86wc" event={"ID":"06d51315-6389-42de-8ac4-28d350e61677","Type":"ContainerStarted","Data":"87faab83c828d34e2d9f4e7b770fe55459895f9cba99e9274cf64818c7093862"} Jul 27 21:04:39.087786 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.087680 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:39.087786 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.087748 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:39.087999 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.087833 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:39.087999 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.087866 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:39.087999 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.087908 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs podName:56e54f19-f7c4-4828-9333-7f61dacd4781 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:41.087887686 +0000 UTC m=+6.030908699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs") pod "network-metrics-daemon-fk22f" (UID: "56e54f19-f7c4-4828-9333-7f61dacd4781") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:39.087999 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.087928 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret podName:a22b8bbf-dcd5-4856-ba68-ee02abe770b7 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:41.087918823 +0000 UTC m=+6.030939835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret") pod "global-pull-secret-syncer-7sbtn" (UID: "a22b8bbf-dcd5-4856-ba68-ee02abe770b7") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:39.188979 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.188939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:39.189243 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.189224 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:39.189330 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.189254 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:39.189330 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.189269 2575 projected.go:196] Error preparing data for projected volume kube-api-access-mc95z for pod openshift-network-diagnostics/network-check-target-26hcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:39.189330 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.189328 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z podName:29b4c36b-f1cc-4e94-8f69-ba1141da6f41 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:41.189309777 +0000 UTC m=+6.132330787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mc95z" (UniqueName: "kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z") pod "network-check-target-26hcs" (UID: "29b4c36b-f1cc-4e94-8f69-ba1141da6f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:39.516260 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.516053 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 20:59:37 +0000 UTC" deadline="2028-01-03 00:06:27.082590796 +0000 UTC" Jul 27 21:04:39.516260 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.516133 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12579h1m47.566462619s" Jul 27 21:04:39.667754 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.666978 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:39.667754 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.667112 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:39.667754 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.667582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:39.667754 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:39.667679 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:39.722862 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.722777 2575 generic.go:356] "Generic (PLEG): container finished" podID="8a694ad3c82de933979ec656930c63e0" containerID="2229f0a32ca23b885e0c76953101ad14f0357b436d8733c2fca2cde8c19c837b" exitCode=0 Jul 27 21:04:39.723076 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.722880 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" event={"ID":"8a694ad3c82de933979ec656930c63e0","Type":"ContainerDied","Data":"2229f0a32ca23b885e0c76953101ad14f0357b436d8733c2fca2cde8c19c837b"} Jul 27 21:04:39.738567 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.738134 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" event={"ID":"be484760452c4488384d3c6b0a59fc4e","Type":"ContainerStarted","Data":"884a6e3df685672fb1c87c2a4d3c9b8224696c053ca80e481cbfe6cb24ed7b2f"} Jul 27 21:04:39.757818 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:39.757364 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-153.ec2.internal" podStartSLOduration=3.757342351 podStartE2EDuration="3.757342351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:39.756683244 +0000 UTC m=+4.699704274" watchObservedRunningTime="2026-07-27 21:04:39.757342351 +0000 UTC m=+4.700363382" Jul 27 21:04:40.664585 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:40.664552 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:40.665028 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:40.664699 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:40.753794 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:40.753750 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" event={"ID":"8a694ad3c82de933979ec656930c63e0","Type":"ContainerStarted","Data":"e37f1e1a9bd21bc62996142f072f8cea599029487e0a867cf7e3702b890213e6"} Jul 27 21:04:41.103978 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:41.103168 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:41.103978 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:41.103224 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:41.103978 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.103360 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:41.103978 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.103447 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret podName:a22b8bbf-dcd5-4856-ba68-ee02abe770b7 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:45.103406716 +0000 UTC m=+10.046427726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret") pod "global-pull-secret-syncer-7sbtn" (UID: "a22b8bbf-dcd5-4856-ba68-ee02abe770b7") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:41.103978 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.103840 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:41.103978 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.103892 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs podName:56e54f19-f7c4-4828-9333-7f61dacd4781 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:45.103876937 +0000 UTC m=+10.046897950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs") pod "network-metrics-daemon-fk22f" (UID: "56e54f19-f7c4-4828-9333-7f61dacd4781") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:41.204228 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:41.204190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:41.204417 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.204370 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:41.204417 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.204390 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:41.204417 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.204402 2575 projected.go:196] Error preparing data for projected volume kube-api-access-mc95z for pod openshift-network-diagnostics/network-check-target-26hcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:41.204616 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.204482 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z podName:29b4c36b-f1cc-4e94-8f69-ba1141da6f41 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:45.204462606 +0000 UTC m=+10.147483626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mc95z" (UniqueName: "kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z") pod "network-check-target-26hcs" (UID: "29b4c36b-f1cc-4e94-8f69-ba1141da6f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:41.664838 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:41.664804 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:41.665285 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.664940 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:41.665362 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:41.665324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:41.665468 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:41.665443 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:42.665177 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:42.665141 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:42.665628 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:42.665290 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:43.668544 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:43.667861 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:43.668544 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:43.667979 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:43.668544 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:43.668370 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:43.668544 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:43.668490 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:44.665215 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:44.665179 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:44.665411 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:44.665333 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:45.142673 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:45.141777 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:45.142673 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:45.141836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:45.142673 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.141993 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:45.142673 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.142061 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret podName:a22b8bbf-dcd5-4856-ba68-ee02abe770b7 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:53.142039447 +0000 UTC m=+18.085060475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret") pod "global-pull-secret-syncer-7sbtn" (UID: "a22b8bbf-dcd5-4856-ba68-ee02abe770b7") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:45.142673 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.142545 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:45.142673 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.142589 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs podName:56e54f19-f7c4-4828-9333-7f61dacd4781 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:53.142578028 +0000 UTC m=+18.085599035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs") pod "network-metrics-daemon-fk22f" (UID: "56e54f19-f7c4-4828-9333-7f61dacd4781") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:45.242374 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:45.242262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:45.242555 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.242442 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:45.242555 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.242469 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:45.242555 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.242482 2575 projected.go:196] Error preparing data for projected volume kube-api-access-mc95z for pod openshift-network-diagnostics/network-check-target-26hcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:45.242555 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.242545 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z podName:29b4c36b-f1cc-4e94-8f69-ba1141da6f41 nodeName:}" failed. No retries permitted until 2026-07-27 21:04:53.242529325 +0000 UTC m=+18.185550343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mc95z" (UniqueName: "kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z") pod "network-check-target-26hcs" (UID: "29b4c36b-f1cc-4e94-8f69-ba1141da6f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:45.665106 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:45.665068 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:45.665278 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.665214 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:45.665339 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:45.665294 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:45.665408 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:45.665389 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:46.664872 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:46.664729 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:46.665342 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:46.664871 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:47.665155 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:47.665120 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:47.665640 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:47.665131 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:47.665640 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:47.665256 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:47.665640 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:47.665357 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:48.664684 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:48.664651 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:48.664882 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:48.664795 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:49.664813 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:49.664773 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:49.665234 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:49.664828 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:49.665234 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:49.664911 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:49.665234 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:49.665004 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:50.665917 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:50.665066 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:50.665917 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:50.665219 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:51.667656 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:51.667628 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:51.668121 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:51.667628 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:51.668121 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:51.667749 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:51.668121 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:51.667798 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:52.665008 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:52.664974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:52.665187 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:52.665113 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:53.199136 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:53.199092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:53.199554 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:53.199194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:53.199554 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.199238 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:53.199554 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.199277 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:53.199554 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.199310 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret podName:a22b8bbf-dcd5-4856-ba68-ee02abe770b7 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:09.199291364 +0000 UTC m=+34.142312393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret") pod "global-pull-secret-syncer-7sbtn" (UID: "a22b8bbf-dcd5-4856-ba68-ee02abe770b7") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:04:53.199554 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.199328 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs podName:56e54f19-f7c4-4828-9333-7f61dacd4781 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:09.199319622 +0000 UTC m=+34.142340629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs") pod "network-metrics-daemon-fk22f" (UID: "56e54f19-f7c4-4828-9333-7f61dacd4781") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:04:53.299959 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:53.299918 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:53.300126 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.300097 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:04:53.300126 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.300120 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:04:53.300229 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.300130 2575 projected.go:196] Error preparing data for projected volume kube-api-access-mc95z for pod openshift-network-diagnostics/network-check-target-26hcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:53.300229 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.300189 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z podName:29b4c36b-f1cc-4e94-8f69-ba1141da6f41 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:09.300173734 +0000 UTC m=+34.243194754 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mc95z" (UniqueName: "kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z") pod "network-check-target-26hcs" (UID: "29b4c36b-f1cc-4e94-8f69-ba1141da6f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:04:53.667689 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:53.667653 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:53.667850 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.667760 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:53.667850 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:53.667827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:53.667933 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:53.667912 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:54.665112 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:54.665073 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:54.665549 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:54.665228 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:55.665108 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:55.665071 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:55.665596 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:55.665193 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:55.665596 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:55.665195 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:55.665596 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:55.665291 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:56.665163 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:56.664709 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:56.665163 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:56.664845 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:57.664609 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.664412 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:57.664760 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.664504 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:57.664760 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:57.664688 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:57.664874 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:57.664757 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:57.790944 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.790740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-52fqc" event={"ID":"f6a58687-1aed-4540-ba0e-c4f32ada0330","Type":"ContainerStarted","Data":"525e1e4f412c40e05d10b01e46bb201be3664fd8a4345d0939b24b848e139ca3"} Jul 27 21:04:57.792303 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.792276 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" event={"ID":"4d185361-644f-4d31-9f5f-8913d2b7b173","Type":"ContainerStarted","Data":"678443d05b36c4d728650b5cf22c7865f4851d8a4b5d0098a2422c8666d7fd93"} Jul 27 21:04:57.794122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.794098 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-thftq" event={"ID":"23060fe1-e58e-47b8-b213-1e259ef3b79c","Type":"ContainerStarted","Data":"ef298948a517cf65e491202619d74fc33963126160298bde7bb9f309c1833efc"} Jul 27 21:04:57.796130 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.796114 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:04:57.796477 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.796451 2575 generic.go:356] "Generic (PLEG): container finished" podID="72422086-5752-4ba5-8c13-0521ac39e0f3" containerID="105c12b1119a9b24e4cdeabb5c7f840cf259374bd65e02397708d6d5346075a7" exitCode=1 Jul 27 21:04:57.796575 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.796530 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerStarted","Data":"067dbded4e7a50eeff6aada2169fb0e04023674e06f3edd566daa8eca8fad914"} Jul 27 21:04:57.796618 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.796605 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerStarted","Data":"7ca214a85cdb8b3b9d52030b6a91555ba1b3a1ed2aac31a4ed0e981722db338b"} Jul 27 21:04:57.796665 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.796658 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerDied","Data":"105c12b1119a9b24e4cdeabb5c7f840cf259374bd65e02397708d6d5346075a7"} Jul 27 21:04:57.796721 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.796709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerStarted","Data":"794c8b0731d8b1d6d3c9ad75983e3f369699e4a788d2638eb090422e64c439d2"} Jul 27 21:04:57.798022 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.798000 2575 generic.go:356] "Generic (PLEG): container finished" podID="3c240878-122d-4ffe-85bb-00f3ffcf15c9" containerID="9a7c71c9bda71da51bd3b641ec04a6127cc28bf1ce1319a24a6079665563d245" exitCode=0 Jul 27 21:04:57.798114 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.798082 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" event={"ID":"3c240878-122d-4ffe-85bb-00f3ffcf15c9","Type":"ContainerDied","Data":"9a7c71c9bda71da51bd3b641ec04a6127cc28bf1ce1319a24a6079665563d245"} Jul 27 21:04:57.802634 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.800284 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" event={"ID":"157f3110-39dc-44b2-8148-5171965fbc8a","Type":"ContainerStarted","Data":"261e2f2fee02ae5adacc9c8736e7ea70a692c51edb357919fc51dc1897a4ed7f"} Jul 27 21:04:57.802634 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.801936 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sw9mr" event={"ID":"3f1eb411-3b84-4744-9381-c1dfad2b10b5","Type":"ContainerStarted","Data":"b9178e20ca15fc320c859ef8cacbeaf0967b3d1aafbf738c924735185a51a73a"} Jul 27 21:04:57.803882 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.803863 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w86wc" event={"ID":"06d51315-6389-42de-8ac4-28d350e61677","Type":"ContainerStarted","Data":"639ee23bc9ffe96e3ebb304ac8497c87c879f96959e1f13007f166e71fc3331f"} Jul 27 21:04:57.820792 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.820748 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-153.ec2.internal" podStartSLOduration=21.820712252 podStartE2EDuration="21.820712252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:40.774089285 +0000 UTC m=+5.717110315" watchObservedRunningTime="2026-07-27 21:04:57.820712252 +0000 UTC m=+22.763733283" Jul 27 21:04:57.836992 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.836552 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-thftq" podStartSLOduration=4.371366332 podStartE2EDuration="22.836536096s" totalImagesPullingTime="18.465169764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:57.836147503 +0000 UTC m=+22.779168533" watchObservedRunningTime="2026-07-27 21:04:57.836536096 +0000 UTC m=+22.779557104" Jul 27 21:04:57.854416 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.854377 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w86wc" podStartSLOduration=4.354950088 podStartE2EDuration="22.854363803s" totalImagesPullingTime="18.499413715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:57.854348586 +0000 UTC m=+22.797369616" watchObservedRunningTime="2026-07-27 21:04:57.854363803 +0000 UTC m=+22.797384831" Jul 27 21:04:57.877895 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.877846 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sw9mr" podStartSLOduration=4.400435739 podStartE2EDuration="22.877827096s" totalImagesPullingTime="18.477391357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:57.877724921 +0000 UTC m=+22.820745951" watchObservedRunningTime="2026-07-27 21:04:57.877827096 +0000 UTC m=+22.820848137" Jul 27 21:04:57.898316 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.898276 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9lvcm" podStartSLOduration=4.426019598 podStartE2EDuration="22.89826312s" totalImagesPullingTime="18.472243522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:57.897911297 +0000 UTC m=+22.840932339" watchObservedRunningTime="2026-07-27 21:04:57.89826312 +0000 UTC m=+22.841284148" Jul 27 21:04:57.919094 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:57.919040 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-52fqc" podStartSLOduration=3.433093536 podStartE2EDuration="21.91901966s" totalImagesPullingTime="18.485926124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:57.917938539 +0000 UTC m=+22.860959570" watchObservedRunningTime="2026-07-27 21:04:57.91901966 +0000 UTC m=+22.862040690" Jul 27 21:04:58.356395 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.356367 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 21:04:58.524729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.524565 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T21:04:58.356389798Z","UUID":"515559cb-1c69-42ba-ba17-ad55d869860f","Handler":null,"Name":"","Endpoint":""} Jul 27 21:04:58.526360 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.526336 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 21:04:58.526504 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.526382 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 21:04:58.664195 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.664171 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:04:58.664367 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:58.664284 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:04:58.808929 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.808840 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" event={"ID":"4d185361-644f-4d31-9f5f-8913d2b7b173","Type":"ContainerStarted","Data":"8f2ce09c78bad24bd02b0cdca42adcfe203ff9738204d6a751b2982c0941e329"} Jul 27 21:04:58.813383 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.813360 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:04:58.813897 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.813865 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerStarted","Data":"e5eddb8a89c2467edb6863e6168f3393ae62b109897fef5c9ac0d0ae5a40ddfa"} Jul 27 21:04:58.814002 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.813984 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerStarted","Data":"4804a34745d33aa3c11f8f3f218f6ab84d616ebbf71786289bde9bf2c4111702"} Jul 27 21:04:58.815911 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.815875 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-65gz9" event={"ID":"e5a52839-770b-4575-9afa-fdc879260cbd","Type":"ContainerStarted","Data":"f5229c1e3488d754b4c3d65cee0a87762640de99cf0e0abb3590a2f40164007c"} Jul 27 21:04:58.833203 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:58.833162 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-65gz9" podStartSLOduration=5.340043474 podStartE2EDuration="23.833144841s" totalImagesPullingTime="18.493101367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:58.832230592 +0000 UTC m=+23.775251622" watchObservedRunningTime="2026-07-27 21:04:58.833144841 +0000 UTC m=+23.776165874" Jul 27 21:04:59.664309 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:59.664182 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:04:59.664371 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:59.664300 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:04:59.664453 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:59.664376 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:04:59.664548 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:04:59.664480 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:04:59.820851 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:04:59.820768 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" event={"ID":"4d185361-644f-4d31-9f5f-8913d2b7b173","Type":"ContainerStarted","Data":"77f1a17592925e32a9d0415b7c22381094b2f408a65469d6f694b1fb10bca3c8"} Jul 27 21:05:00.461307 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:00.461056 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:05:00.461702 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:00.461676 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:05:00.490252 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:00.490168 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jckkk" podStartSLOduration=4.945959809 podStartE2EDuration="25.490147056s" totalImagesPullingTime="20.544187247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:04:59.84934501 +0000 UTC m=+24.792366039" watchObservedRunningTime="2026-07-27 21:05:00.490147056 +0000 UTC m=+25.433168089" Jul 27 21:05:00.664341 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:00.664303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:00.664528 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:00.664461 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:05:00.827332 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:00.827261 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:05:00.827877 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:00.827838 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerStarted","Data":"46f44e4b9c54527a69a93dfdaf42a7cf3aa405b5e5a0d49b3f02039f876247ea"} Jul 27 21:05:01.664584 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:01.664548 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:01.664788 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:01.664679 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:05:01.664788 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:01.664719 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:01.664788 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:01.664781 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:05:02.245613 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.245560 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:05:02.246417 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.245672 2575 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 27 21:05:02.247620 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.246495 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sw9mr" Jul 27 21:05:02.664929 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.664762 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:02.665057 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:02.665016 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:05:02.835738 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.835701 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:05:02.836099 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.836078 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerStarted","Data":"776ee0944465b5627303ebfc7d3941e7612f8d93214677df5c18cc3ef444169f"} Jul 27 21:05:02.836349 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.836335 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:05:02.836589 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.836560 2575 scope.go:117] "RemoveContainer" containerID="105c12b1119a9b24e4cdeabb5c7f840cf259374bd65e02397708d6d5346075a7" Jul 27 21:05:02.838326 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.838304 2575 generic.go:356] "Generic (PLEG): container finished" podID="3c240878-122d-4ffe-85bb-00f3ffcf15c9" containerID="876624e47c8702cc88071cb6fd6fe8239fd8f02fe0882e630d780be701121d0f" exitCode=0 Jul 27 21:05:02.838448 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.838394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" event={"ID":"3c240878-122d-4ffe-85bb-00f3ffcf15c9","Type":"ContainerDied","Data":"876624e47c8702cc88071cb6fd6fe8239fd8f02fe0882e630d780be701121d0f"} Jul 27 21:05:02.856222 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:02.856201 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:05:03.664326 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.664295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:03.664958 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.664343 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:03.664958 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:03.664463 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:05:03.664958 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:03.664492 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:05:03.844124 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.844049 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:05:03.844487 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.844457 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" event={"ID":"72422086-5752-4ba5-8c13-0521ac39e0f3","Type":"ContainerStarted","Data":"26d712bedb90af21388c89dfd8eb3e81f1a1f89c75834b2b41ecfaa3dcfe7c4f"} Jul 27 21:05:03.844787 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.844766 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:05:03.844944 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.844921 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:05:03.847052 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.847025 2575 generic.go:356] "Generic (PLEG): container finished" podID="3c240878-122d-4ffe-85bb-00f3ffcf15c9" containerID="d88a9ae370546cac482d4662a9c59ce80d6c2f2dc7f583a154b776bf9557938d" exitCode=0 Jul 27 21:05:03.847154 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.847080 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" event={"ID":"3c240878-122d-4ffe-85bb-00f3ffcf15c9","Type":"ContainerDied","Data":"d88a9ae370546cac482d4662a9c59ce80d6c2f2dc7f583a154b776bf9557938d"} Jul 27 21:05:03.861861 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.861836 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:05:03.875500 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:03.875440 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" podStartSLOduration=10.090946306 podStartE2EDuration="28.875398871s" totalImagesPullingTime="18.784452565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:03.874939802 +0000 UTC m=+28.817960832" watchObservedRunningTime="2026-07-27 21:05:03.875398871 +0000 UTC m=+28.818419902" Jul 27 21:05:04.142730 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:04.142643 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7sbtn"] Jul 27 21:05:04.142874 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:04.142811 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:04.142950 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:04.142927 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:05:04.145616 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:04.145594 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26hcs"] Jul 27 21:05:04.145734 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:04.145687 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:04.145795 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:04.145768 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:05:04.147813 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:04.147790 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fk22f"] Jul 27 21:05:04.147917 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:04.147889 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:04.148020 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:04.147980 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:05:04.852118 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:04.851881 2575 generic.go:356] "Generic (PLEG): container finished" podID="3c240878-122d-4ffe-85bb-00f3ffcf15c9" containerID="198f8abf3d949c17abf9dc64158fa431c52823a958be526bfa45ef57cd2568a7" exitCode=0 Jul 27 21:05:04.852118 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:04.851938 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" event={"ID":"3c240878-122d-4ffe-85bb-00f3ffcf15c9","Type":"ContainerDied","Data":"198f8abf3d949c17abf9dc64158fa431c52823a958be526bfa45ef57cd2568a7"} Jul 27 21:05:05.665590 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:05.665557 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:05.665807 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:05.665643 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:05.665807 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:05.665645 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:05:05.665807 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:05.665754 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:05:05.665807 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:05.665769 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:05.665990 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:05.665879 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:05:07.664386 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:07.664351 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:07.664386 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:07.664389 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:07.665260 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:07.664352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:07.665260 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:07.664513 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:05:07.665260 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:07.664611 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:05:07.665260 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:07.664682 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:05:09.221639 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.221602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:09.222156 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.221673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:09.222156 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.221758 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 21:05:09.222156 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.221778 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:05:09.222156 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.221825 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret podName:a22b8bbf-dcd5-4856-ba68-ee02abe770b7 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:41.221808569 +0000 UTC m=+66.164829576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret") pod "global-pull-secret-syncer-7sbtn" (UID: "a22b8bbf-dcd5-4856-ba68-ee02abe770b7") : object "kube-system"/"original-pull-secret" not registered Jul 27 21:05:09.222156 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.221840 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs podName:56e54f19-f7c4-4828-9333-7f61dacd4781 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:41.221832898 +0000 UTC m=+66.164853904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs") pod "network-metrics-daemon-fk22f" (UID: "56e54f19-f7c4-4828-9333-7f61dacd4781") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 21:05:09.322542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.322507 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:09.322723 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.322681 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 21:05:09.322723 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.322703 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 21:05:09.322723 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.322713 2575 projected.go:196] Error preparing data for projected volume kube-api-access-mc95z for pod openshift-network-diagnostics/network-check-target-26hcs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:05:09.322824 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.322766 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z podName:29b4c36b-f1cc-4e94-8f69-ba1141da6f41 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:41.322750195 +0000 UTC m=+66.265771202 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mc95z" (UniqueName: "kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z") pod "network-check-target-26hcs" (UID: "29b4c36b-f1cc-4e94-8f69-ba1141da6f41") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 21:05:09.664809 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.664777 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:09.665020 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.664776 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:09.665020 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.664893 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7sbtn" podUID="a22b8bbf-dcd5-4856-ba68-ee02abe770b7" Jul 27 21:05:09.665020 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.664913 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:09.665020 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.665005 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26hcs" podUID="29b4c36b-f1cc-4e94-8f69-ba1141da6f41" Jul 27 21:05:09.665175 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:09.665098 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fk22f" podUID="56e54f19-f7c4-4828-9333-7f61dacd4781" Jul 27 21:05:09.839744 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.839720 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-153.ec2.internal" event="NodeReady" Jul 27 21:05:09.839912 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.839846 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 21:05:09.867301 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.867270 2575 generic.go:356] "Generic (PLEG): container finished" podID="3c240878-122d-4ffe-85bb-00f3ffcf15c9" containerID="7730ac748223fa12b239a63c795298fbbaf2d2600eaffc28b367f8ee530ac5ba" exitCode=0 Jul 27 21:05:09.867491 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.867312 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" event={"ID":"3c240878-122d-4ffe-85bb-00f3ffcf15c9","Type":"ContainerDied","Data":"7730ac748223fa12b239a63c795298fbbaf2d2600eaffc28b367f8ee530ac5ba"} Jul 27 21:05:09.887401 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.887379 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cpc2t"] Jul 27 21:05:09.905532 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.905504 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rw4mc"] Jul 27 21:05:09.905727 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.905655 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:09.908802 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.908778 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k6b4w\"" Jul 27 21:05:09.909067 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.909041 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 21:05:09.909067 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.909062 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 21:05:09.919549 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.919522 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cpc2t"] Jul 27 21:05:09.919664 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.919576 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rw4mc"] Jul 27 21:05:09.919717 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.919680 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rw4mc" Jul 27 21:05:09.922696 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.922674 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 21:05:09.922809 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.922677 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5hshq\"" Jul 27 21:05:09.922809 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.922674 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 21:05:09.922922 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:09.922718 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 21:05:10.027474 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.027440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.027474 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.027474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b8f52aa-bdb5-4a39-9233-df881ec8d638-tmp-dir\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.027690 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.027625 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b8f52aa-bdb5-4a39-9233-df881ec8d638-config-volume\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.027743 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.027685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkhtx\" (UniqueName: \"kubernetes.io/projected/5b8f52aa-bdb5-4a39-9233-df881ec8d638-kube-api-access-nkhtx\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.027743 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.027718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33ed798f-d12c-4ca1-8ed5-c96de1ba18de-cert\") pod \"ingress-canary-rw4mc\" (UID: \"33ed798f-d12c-4ca1-8ed5-c96de1ba18de\") " pod="openshift-ingress-canary/ingress-canary-rw4mc" Jul 27 21:05:10.027837 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.027774 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv5qr\" (UniqueName: \"kubernetes.io/projected/33ed798f-d12c-4ca1-8ed5-c96de1ba18de-kube-api-access-dv5qr\") pod \"ingress-canary-rw4mc\" (UID: \"33ed798f-d12c-4ca1-8ed5-c96de1ba18de\") " pod="openshift-ingress-canary/ingress-canary-rw4mc" Jul 27 21:05:10.128271 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.128235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.128271 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.128273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b8f52aa-bdb5-4a39-9233-df881ec8d638-tmp-dir\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.128519 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.128304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b8f52aa-bdb5-4a39-9233-df881ec8d638-config-volume\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.128519 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.128348 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkhtx\" (UniqueName: \"kubernetes.io/projected/5b8f52aa-bdb5-4a39-9233-df881ec8d638-kube-api-access-nkhtx\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.128519 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.128372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33ed798f-d12c-4ca1-8ed5-c96de1ba18de-cert\") pod \"ingress-canary-rw4mc\" (UID: \"33ed798f-d12c-4ca1-8ed5-c96de1ba18de\") " pod="openshift-ingress-canary/ingress-canary-rw4mc" Jul 27 21:05:10.128519 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:10.128393 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:05:10.128519 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.128449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv5qr\" (UniqueName: \"kubernetes.io/projected/33ed798f-d12c-4ca1-8ed5-c96de1ba18de-kube-api-access-dv5qr\") pod \"ingress-canary-rw4mc\" (UID: \"33ed798f-d12c-4ca1-8ed5-c96de1ba18de\") " pod="openshift-ingress-canary/ingress-canary-rw4mc" Jul 27 21:05:10.128519 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:10.128484 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls podName:5b8f52aa-bdb5-4a39-9233-df881ec8d638 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:10.628464455 +0000 UTC m=+35.571485461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls") pod "dns-default-cpc2t" (UID: "5b8f52aa-bdb5-4a39-9233-df881ec8d638") : secret "dns-default-metrics-tls" not found Jul 27 21:05:10.128771 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.128657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b8f52aa-bdb5-4a39-9233-df881ec8d638-tmp-dir\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.128940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.128923 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b8f52aa-bdb5-4a39-9233-df881ec8d638-config-volume\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.132903 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.132877 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33ed798f-d12c-4ca1-8ed5-c96de1ba18de-cert\") pod \"ingress-canary-rw4mc\" (UID: \"33ed798f-d12c-4ca1-8ed5-c96de1ba18de\") " pod="openshift-ingress-canary/ingress-canary-rw4mc" Jul 27 21:05:10.136707 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.136685 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv5qr\" (UniqueName: \"kubernetes.io/projected/33ed798f-d12c-4ca1-8ed5-c96de1ba18de-kube-api-access-dv5qr\") pod \"ingress-canary-rw4mc\" (UID: \"33ed798f-d12c-4ca1-8ed5-c96de1ba18de\") " pod="openshift-ingress-canary/ingress-canary-rw4mc" Jul 27 21:05:10.137286 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.137270 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkhtx\" (UniqueName: \"kubernetes.io/projected/5b8f52aa-bdb5-4a39-9233-df881ec8d638-kube-api-access-nkhtx\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.229373 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.229187 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rw4mc" Jul 27 21:05:10.413008 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.412887 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rw4mc"] Jul 27 21:05:10.419763 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:10.419735 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33ed798f_d12c_4ca1_8ed5_c96de1ba18de.slice/crio-fedae068997508194fcdec0f158cbc23e8edffd1e2aac20604b180f591c6d611 WatchSource:0}: Error finding container fedae068997508194fcdec0f158cbc23e8edffd1e2aac20604b180f591c6d611: Status 404 returned error can't find the container with id fedae068997508194fcdec0f158cbc23e8edffd1e2aac20604b180f591c6d611 Jul 27 21:05:10.632169 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.632092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:10.632322 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:10.632250 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:05:10.632322 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:10.632315 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls podName:5b8f52aa-bdb5-4a39-9233-df881ec8d638 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:11.632299704 +0000 UTC m=+36.575320711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls") pod "dns-default-cpc2t" (UID: "5b8f52aa-bdb5-4a39-9233-df881ec8d638") : secret "dns-default-metrics-tls" not found Jul 27 21:05:10.872683 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.872648 2575 generic.go:356] "Generic (PLEG): container finished" podID="3c240878-122d-4ffe-85bb-00f3ffcf15c9" containerID="7c55f7c93b5c2b87abcf5cd2916e08674ed86851cbb35c045e910b5fa3ef139c" exitCode=0 Jul 27 21:05:10.872925 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.872725 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" event={"ID":"3c240878-122d-4ffe-85bb-00f3ffcf15c9","Type":"ContainerDied","Data":"7c55f7c93b5c2b87abcf5cd2916e08674ed86851cbb35c045e910b5fa3ef139c"} Jul 27 21:05:10.873882 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:10.873853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rw4mc" event={"ID":"33ed798f-d12c-4ca1-8ed5-c96de1ba18de","Type":"ContainerStarted","Data":"fedae068997508194fcdec0f158cbc23e8edffd1e2aac20604b180f591c6d611"} Jul 27 21:05:11.640749 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.640712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:11.641269 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:11.640893 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:05:11.641269 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:11.640960 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls podName:5b8f52aa-bdb5-4a39-9233-df881ec8d638 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:13.640941038 +0000 UTC m=+38.583962049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls") pod "dns-default-cpc2t" (UID: "5b8f52aa-bdb5-4a39-9233-df881ec8d638") : secret "dns-default-metrics-tls" not found Jul 27 21:05:11.664781 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.664744 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:11.664979 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.664746 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:11.664979 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.664948 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:11.668307 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.668283 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 21:05:11.668307 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.668303 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 21:05:11.669659 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.669636 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5l9j\"" Jul 27 21:05:11.669778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.669685 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r4zfp\"" Jul 27 21:05:11.669778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.669746 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 21:05:11.669778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.669690 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 21:05:11.879372 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.879342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" event={"ID":"3c240878-122d-4ffe-85bb-00f3ffcf15c9","Type":"ContainerStarted","Data":"08e3c10f8c2a0a336f504d3c0efe51207096f5e650f368411083354fbd7a1e46"} Jul 27 21:05:11.906987 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:11.906940 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pwrdj" podStartSLOduration=8.415621868 podStartE2EDuration="36.906918927s" totalImagesPullingTime="28.491297059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:11.906636493 +0000 UTC m=+36.849657521" watchObservedRunningTime="2026-07-27 21:05:11.906918927 +0000 UTC m=+36.849939951" Jul 27 21:05:13.658393 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:13.658160 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:13.658853 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:13.658323 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:05:13.658853 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:13.658522 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls podName:5b8f52aa-bdb5-4a39-9233-df881ec8d638 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:17.658504063 +0000 UTC m=+42.601525070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls") pod "dns-default-cpc2t" (UID: "5b8f52aa-bdb5-4a39-9233-df881ec8d638") : secret "dns-default-metrics-tls" not found Jul 27 21:05:13.884559 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:13.884517 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rw4mc" event={"ID":"33ed798f-d12c-4ca1-8ed5-c96de1ba18de","Type":"ContainerStarted","Data":"d1f80eed46fcbb539441613ad9920b7811b64010f6f1dda84b4860fe8a2e668a"} Jul 27 21:05:13.901581 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:13.901528 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rw4mc" podStartSLOduration=2.287783489 podStartE2EDuration="4.901512649s" totalImagesPullingTime="2.61372916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:13.900735066 +0000 UTC m=+38.843756095" watchObservedRunningTime="2026-07-27 21:05:13.901512649 +0000 UTC m=+38.844533678" Jul 27 21:05:17.687806 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:17.687778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:17.688614 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:17.687908 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:05:17.688614 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:17.687967 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls podName:5b8f52aa-bdb5-4a39-9233-df881ec8d638 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:25.687951913 +0000 UTC m=+50.630972921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls") pod "dns-default-cpc2t" (UID: "5b8f52aa-bdb5-4a39-9233-df881ec8d638") : secret "dns-default-metrics-tls" not found Jul 27 21:05:20.393979 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.393946 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-9lh9h"] Jul 27 21:05:20.439112 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.439076 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h"] Jul 27 21:05:20.439293 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.439222 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.441900 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.441871 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 27 21:05:20.442230 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.442214 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 27 21:05:20.443194 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.443172 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 27 21:05:20.443316 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.443200 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6nwfn\"" Jul 27 21:05:20.443316 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.443207 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 27 21:05:20.448108 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.448090 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 27 21:05:20.454806 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.454789 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-9lh9h"] Jul 27 21:05:20.454891 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.454819 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h"] Jul 27 21:05:20.454927 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.454891 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:20.457536 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.457513 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 27 21:05:20.457636 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.457526 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 27 21:05:20.457636 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.457590 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fk5tp\"" Jul 27 21:05:20.457636 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.457600 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 27 21:05:20.472127 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.472104 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc"] Jul 27 21:05:20.490859 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.490832 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc"] Jul 27 21:05:20.490947 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.490910 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.493923 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.493889 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 27 21:05:20.494350 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.494332 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 27 21:05:20.494473 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.494434 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 27 21:05:20.494709 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.494688 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hzvmn\"" Jul 27 21:05:20.494786 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.494771 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 27 21:05:20.564768 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.564741 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw"] Jul 27 21:05:20.586139 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.586107 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw"] Jul 27 21:05:20.586257 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.586232 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:20.589199 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.589178 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 27 21:05:20.589322 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.589269 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h8jbb\"" Jul 27 21:05:20.589388 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.589360 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 27 21:05:20.610093 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.610056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d65d11be-b256-44ef-a27a-cb191debeb86-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc\" (UID: \"d65d11be-b256-44ef-a27a-cb191debeb86\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.610393 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.610366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4357648-98b8-4ce0-8ddc-029955ffeabb-serving-cert\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.610506 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.610414 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4357648-98b8-4ce0-8ddc-029955ffeabb-trusted-ca\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.610561 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.610544 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7c2h\" (UniqueName: \"kubernetes.io/projected/f4357648-98b8-4ce0-8ddc-029955ffeabb-kube-api-access-p7c2h\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.610615 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.610573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4357648-98b8-4ce0-8ddc-029955ffeabb-config\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.610661 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.610646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:20.610708 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.610678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncddg\" (UniqueName: \"kubernetes.io/projected/d65d11be-b256-44ef-a27a-cb191debeb86-kube-api-access-ncddg\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc\" (UID: \"d65d11be-b256-44ef-a27a-cb191debeb86\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.610754 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.610712 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65d11be-b256-44ef-a27a-cb191debeb86-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc\" (UID: \"d65d11be-b256-44ef-a27a-cb191debeb86\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.610803 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.610753 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw7fj\" (UniqueName: \"kubernetes.io/projected/876a868a-99b3-421a-b781-cf4d490debf8-kube-api-access-fw7fj\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:20.711060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7c2h\" (UniqueName: \"kubernetes.io/projected/f4357648-98b8-4ce0-8ddc-029955ffeabb-kube-api-access-p7c2h\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.711253 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4357648-98b8-4ce0-8ddc-029955ffeabb-config\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.711253 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711101 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:20.711253 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711118 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncddg\" (UniqueName: \"kubernetes.io/projected/d65d11be-b256-44ef-a27a-cb191debeb86-kube-api-access-ncddg\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc\" (UID: \"d65d11be-b256-44ef-a27a-cb191debeb86\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.711253 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711147 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65d11be-b256-44ef-a27a-cb191debeb86-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc\" (UID: \"d65d11be-b256-44ef-a27a-cb191debeb86\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.711253 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw7fj\" (UniqueName: \"kubernetes.io/projected/876a868a-99b3-421a-b781-cf4d490debf8-kube-api-access-fw7fj\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:20.711253 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711197 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d65d11be-b256-44ef-a27a-cb191debeb86-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc\" (UID: \"d65d11be-b256-44ef-a27a-cb191debeb86\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.711253 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:20.711214 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 21:05:20.711641 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:20.711306 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls podName:876a868a-99b3-421a-b781-cf4d490debf8 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:21.211284271 +0000 UTC m=+46.154305301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls") pod "cluster-samples-operator-6748489656-qrs5h" (UID: "876a868a-99b3-421a-b781-cf4d490debf8") : secret "samples-operator-tls" not found Jul 27 21:05:20.711641 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4357648-98b8-4ce0-8ddc-029955ffeabb-serving-cert\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.711641 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4357648-98b8-4ce0-8ddc-029955ffeabb-trusted-ca\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.711641 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7cae463-d4e7-489a-8db9-a51e2976c563-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:20.711641 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711552 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:20.711983 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d65d11be-b256-44ef-a27a-cb191debeb86-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc\" (UID: \"d65d11be-b256-44ef-a27a-cb191debeb86\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.712084 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.711996 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f4357648-98b8-4ce0-8ddc-029955ffeabb-config\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.712123 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.712087 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f4357648-98b8-4ce0-8ddc-029955ffeabb-trusted-ca\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.715222 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.715198 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4357648-98b8-4ce0-8ddc-029955ffeabb-serving-cert\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.715222 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.715209 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d65d11be-b256-44ef-a27a-cb191debeb86-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc\" (UID: \"d65d11be-b256-44ef-a27a-cb191debeb86\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.723827 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.723805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw7fj\" (UniqueName: \"kubernetes.io/projected/876a868a-99b3-421a-b781-cf4d490debf8-kube-api-access-fw7fj\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:20.723963 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.723944 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncddg\" (UniqueName: \"kubernetes.io/projected/d65d11be-b256-44ef-a27a-cb191debeb86-kube-api-access-ncddg\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc\" (UID: \"d65d11be-b256-44ef-a27a-cb191debeb86\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.724969 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.724948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7c2h\" (UniqueName: \"kubernetes.io/projected/f4357648-98b8-4ce0-8ddc-029955ffeabb-kube-api-access-p7c2h\") pod \"console-operator-584dcb6b54-9lh9h\" (UID: \"f4357648-98b8-4ce0-8ddc-029955ffeabb\") " pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.747978 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.747951 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:20.800026 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.799992 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" Jul 27 21:05:20.812280 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.812258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7cae463-d4e7-489a-8db9-a51e2976c563-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:20.812380 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.812304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:20.812476 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:20.812463 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 21:05:20.812539 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:20.812530 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert podName:e7cae463-d4e7-489a-8db9-a51e2976c563 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:21.312512805 +0000 UTC m=+46.255533835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cj8mw" (UID: "e7cae463-d4e7-489a-8db9-a51e2976c563") : secret "networking-console-plugin-cert" not found Jul 27 21:05:20.812921 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.812902 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7cae463-d4e7-489a-8db9-a51e2976c563-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:20.930662 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.930382 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-9lh9h"] Jul 27 21:05:20.934785 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:20.934756 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4357648_98b8_4ce0_8ddc_029955ffeabb.slice/crio-8ba82aa1d4ce4746cb4122e79de73c9ae7027c126155c9ef5b83633da4bbe4c2 WatchSource:0}: Error finding container 8ba82aa1d4ce4746cb4122e79de73c9ae7027c126155c9ef5b83633da4bbe4c2: Status 404 returned error can't find the container with id 8ba82aa1d4ce4746cb4122e79de73c9ae7027c126155c9ef5b83633da4bbe4c2 Jul 27 21:05:20.979413 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:20.979336 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc"] Jul 27 21:05:20.982862 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:20.982835 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65d11be_b256_44ef_a27a_cb191debeb86.slice/crio-b115de048f7b12ee31099a69c51000f6d0111452c89df6a725d00c9457a066f4 WatchSource:0}: Error finding container b115de048f7b12ee31099a69c51000f6d0111452c89df6a725d00c9457a066f4: Status 404 returned error can't find the container with id b115de048f7b12ee31099a69c51000f6d0111452c89df6a725d00c9457a066f4 Jul 27 21:05:21.215915 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:21.215881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:21.216102 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:21.216064 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 21:05:21.216169 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:21.216149 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls podName:876a868a-99b3-421a-b781-cf4d490debf8 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:22.216126599 +0000 UTC m=+47.159147613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls") pod "cluster-samples-operator-6748489656-qrs5h" (UID: "876a868a-99b3-421a-b781-cf4d490debf8") : secret "samples-operator-tls" not found Jul 27 21:05:21.316887 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:21.316797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:21.317041 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:21.316943 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 21:05:21.317041 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:21.317014 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert podName:e7cae463-d4e7-489a-8db9-a51e2976c563 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:22.316996067 +0000 UTC m=+47.260017077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cj8mw" (UID: "e7cae463-d4e7-489a-8db9-a51e2976c563") : secret "networking-console-plugin-cert" not found Jul 27 21:05:21.906645 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:21.906604 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" event={"ID":"d65d11be-b256-44ef-a27a-cb191debeb86","Type":"ContainerStarted","Data":"b115de048f7b12ee31099a69c51000f6d0111452c89df6a725d00c9457a066f4"} Jul 27 21:05:21.907774 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:21.907740 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" event={"ID":"f4357648-98b8-4ce0-8ddc-029955ffeabb","Type":"ContainerStarted","Data":"8ba82aa1d4ce4746cb4122e79de73c9ae7027c126155c9ef5b83633da4bbe4c2"} Jul 27 21:05:22.223326 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:22.223215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:22.223573 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:22.223373 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 21:05:22.223573 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:22.223458 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls podName:876a868a-99b3-421a-b781-cf4d490debf8 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:24.223440692 +0000 UTC m=+49.166461722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls") pod "cluster-samples-operator-6748489656-qrs5h" (UID: "876a868a-99b3-421a-b781-cf4d490debf8") : secret "samples-operator-tls" not found Jul 27 21:05:22.324034 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:22.323993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:22.324209 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:22.324183 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 21:05:22.324283 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:22.324270 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert podName:e7cae463-d4e7-489a-8db9-a51e2976c563 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:24.324248584 +0000 UTC m=+49.267269612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cj8mw" (UID: "e7cae463-d4e7-489a-8db9-a51e2976c563") : secret "networking-console-plugin-cert" not found Jul 27 21:05:24.240062 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:24.239959 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:24.240553 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:24.240134 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 21:05:24.240553 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:24.240227 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls podName:876a868a-99b3-421a-b781-cf4d490debf8 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:28.240200088 +0000 UTC m=+53.183221098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls") pod "cluster-samples-operator-6748489656-qrs5h" (UID: "876a868a-99b3-421a-b781-cf4d490debf8") : secret "samples-operator-tls" not found Jul 27 21:05:24.341363 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:24.341324 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:24.341513 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:24.341497 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 21:05:24.341571 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:24.341560 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert podName:e7cae463-d4e7-489a-8db9-a51e2976c563 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:28.34154258 +0000 UTC m=+53.284563609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cj8mw" (UID: "e7cae463-d4e7-489a-8db9-a51e2976c563") : secret "networking-console-plugin-cert" not found Jul 27 21:05:24.917034 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:24.916993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" event={"ID":"d65d11be-b256-44ef-a27a-cb191debeb86","Type":"ContainerStarted","Data":"e85c29da6f455c6c5ea0f4ff2f4a626c317c57fe27448beeb72a19db7da933ca"} Jul 27 21:05:24.918576 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:24.918554 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/0.log" Jul 27 21:05:24.918694 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:24.918594 2575 generic.go:356] "Generic (PLEG): container finished" podID="f4357648-98b8-4ce0-8ddc-029955ffeabb" containerID="1179dfd29c42e9556595822c16f86db851bd6c34072acc65215c68525147cde9" exitCode=255 Jul 27 21:05:24.918694 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:24.918666 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" event={"ID":"f4357648-98b8-4ce0-8ddc-029955ffeabb","Type":"ContainerDied","Data":"1179dfd29c42e9556595822c16f86db851bd6c34072acc65215c68525147cde9"} Jul 27 21:05:24.918851 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:24.918840 2575 scope.go:117] "RemoveContainer" containerID="1179dfd29c42e9556595822c16f86db851bd6c34072acc65215c68525147cde9" Jul 27 21:05:24.933639 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:24.933595 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" podStartSLOduration=1.957561589 podStartE2EDuration="4.933578092s" totalImagesPullingTime="2.976016503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:24.933088347 +0000 UTC m=+49.876109376" watchObservedRunningTime="2026-07-27 21:05:24.933578092 +0000 UTC m=+49.876599121" Jul 27 21:05:25.349580 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.349326 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w"] Jul 27 21:05:25.363047 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.362976 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w"] Jul 27 21:05:25.363181 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.363061 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w" Jul 27 21:05:25.365801 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.365777 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 27 21:05:25.366136 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.365934 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 27 21:05:25.366136 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.365961 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b9cg5\"" Jul 27 21:05:25.552924 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.552895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r99v\" (UniqueName: \"kubernetes.io/projected/eca792b6-734b-4293-b98b-909faf986dfc-kube-api-access-5r99v\") pod \"migrator-6865c9967-zqg5w\" (UID: \"eca792b6-734b-4293-b98b-909faf986dfc\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w" Jul 27 21:05:25.653317 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.653286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r99v\" (UniqueName: \"kubernetes.io/projected/eca792b6-734b-4293-b98b-909faf986dfc-kube-api-access-5r99v\") pod \"migrator-6865c9967-zqg5w\" (UID: \"eca792b6-734b-4293-b98b-909faf986dfc\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w" Jul 27 21:05:25.676748 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.676724 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r99v\" (UniqueName: \"kubernetes.io/projected/eca792b6-734b-4293-b98b-909faf986dfc-kube-api-access-5r99v\") pod \"migrator-6865c9967-zqg5w\" (UID: \"eca792b6-734b-4293-b98b-909faf986dfc\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w" Jul 27 21:05:25.754577 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.754542 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:25.754725 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:25.754673 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 21:05:25.754765 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:25.754726 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls podName:5b8f52aa-bdb5-4a39-9233-df881ec8d638 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:41.754712909 +0000 UTC m=+66.697733915 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls") pod "dns-default-cpc2t" (UID: "5b8f52aa-bdb5-4a39-9233-df881ec8d638") : secret "dns-default-metrics-tls" not found Jul 27 21:05:25.922934 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.922858 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:05:25.923289 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.923274 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/0.log" Jul 27 21:05:25.923340 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.923308 2575 generic.go:356] "Generic (PLEG): container finished" podID="f4357648-98b8-4ce0-8ddc-029955ffeabb" containerID="8589cb9bdd23f11aae29f2e19827add2137640879dbb9efd72baf200b397d530" exitCode=255 Jul 27 21:05:25.923394 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.923381 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" event={"ID":"f4357648-98b8-4ce0-8ddc-029955ffeabb","Type":"ContainerDied","Data":"8589cb9bdd23f11aae29f2e19827add2137640879dbb9efd72baf200b397d530"} Jul 27 21:05:25.923459 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.923438 2575 scope.go:117] "RemoveContainer" containerID="1179dfd29c42e9556595822c16f86db851bd6c34072acc65215c68525147cde9" Jul 27 21:05:25.923651 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.923631 2575 scope.go:117] "RemoveContainer" containerID="8589cb9bdd23f11aae29f2e19827add2137640879dbb9efd72baf200b397d530" Jul 27 21:05:25.923817 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:25.923791 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-9lh9h_openshift-console-operator(f4357648-98b8-4ce0-8ddc-029955ffeabb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" podUID="f4357648-98b8-4ce0-8ddc-029955ffeabb" Jul 27 21:05:25.973515 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:25.973493 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w" Jul 27 21:05:26.124662 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.124632 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w"] Jul 27 21:05:26.128288 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:26.128124 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca792b6_734b_4293_b98b_909faf986dfc.slice/crio-b3ad331982016a9f0b864158a0219d23739c1c9ce3f8f0fece692eeab5bad9bc WatchSource:0}: Error finding container b3ad331982016a9f0b864158a0219d23739c1c9ce3f8f0fece692eeab5bad9bc: Status 404 returned error can't find the container with id b3ad331982016a9f0b864158a0219d23739c1c9ce3f8f0fece692eeab5bad9bc Jul 27 21:05:26.696693 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.696658 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c66x5"] Jul 27 21:05:26.710733 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.710700 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.713706 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.713676 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 21:05:26.713837 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.713751 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 21:05:26.713837 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.713810 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 21:05:26.714954 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.714930 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 21:05:26.715122 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.714963 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j726j\"" Jul 27 21:05:26.720174 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.720129 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c66x5"] Jul 27 21:05:26.863152 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.863097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-data-volume\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.863322 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.863160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxmgh\" (UniqueName: \"kubernetes.io/projected/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-api-access-fxmgh\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.863322 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.863187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.863322 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.863241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.863322 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.863295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-crio-socket\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.927353 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.927319 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:05:26.927735 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.927713 2575 scope.go:117] "RemoveContainer" containerID="8589cb9bdd23f11aae29f2e19827add2137640879dbb9efd72baf200b397d530" Jul 27 21:05:26.927903 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:26.927865 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-9lh9h_openshift-console-operator(f4357648-98b8-4ce0-8ddc-029955ffeabb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" podUID="f4357648-98b8-4ce0-8ddc-029955ffeabb" Jul 27 21:05:26.928752 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.928726 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w" event={"ID":"eca792b6-734b-4293-b98b-909faf986dfc","Type":"ContainerStarted","Data":"b3ad331982016a9f0b864158a0219d23739c1c9ce3f8f0fece692eeab5bad9bc"} Jul 27 21:05:26.964208 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.964137 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-crio-socket\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.964352 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.964215 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-data-volume\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.964352 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.964243 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxmgh\" (UniqueName: \"kubernetes.io/projected/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-api-access-fxmgh\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.964352 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.964260 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.964352 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.964297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.964352 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.964314 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-crio-socket\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.964611 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:26.964382 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:26.964611 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:26.964446 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:26.964611 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:26.964477 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:27.464457381 +0000 UTC m=+52.407478392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : configmap "kube-rbac-proxy" not found Jul 27 21:05:26.964611 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:26.964518 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:27.464498575 +0000 UTC m=+52.407519600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:26.964747 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.964624 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-data-volume\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:26.976158 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:26.976136 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxmgh\" (UniqueName: \"kubernetes.io/projected/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-api-access-fxmgh\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:27.469788 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:27.469747 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:27.469971 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:27.469805 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:27.469971 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:27.469890 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:27.469971 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:27.469892 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:27.469971 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:27.469943 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:28.469928503 +0000 UTC m=+53.412949511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : configmap "kube-rbac-proxy" not found Jul 27 21:05:27.469971 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:27.469955 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:28.469949662 +0000 UTC m=+53.412970669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:27.933773 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:27.933745 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w" event={"ID":"eca792b6-734b-4293-b98b-909faf986dfc","Type":"ContainerStarted","Data":"26c5f4cfe25aaae1c5b1f533aba4a9d148368d87769311fc8a6074c5c0f89cdc"} Jul 27 21:05:27.934224 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:27.933801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w" event={"ID":"eca792b6-734b-4293-b98b-909faf986dfc","Type":"ContainerStarted","Data":"057a84c99dde6f65ba5e6d25524c1cf712848beba1fec9d77f1b71787957779c"} Jul 27 21:05:27.995926 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:27.995882 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-zqg5w" podStartSLOduration=1.5935281639999999 podStartE2EDuration="2.995866412s" totalImagesPullingTime="1.402338248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:27.994453218 +0000 UTC m=+52.937474246" watchObservedRunningTime="2026-07-27 21:05:27.995866412 +0000 UTC m=+52.938887441" Jul 27 21:05:28.276161 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:28.276074 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:28.276315 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:28.276234 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 21:05:28.276315 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:28.276313 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls podName:876a868a-99b3-421a-b781-cf4d490debf8 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:36.276295971 +0000 UTC m=+61.219316979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls") pod "cluster-samples-operator-6748489656-qrs5h" (UID: "876a868a-99b3-421a-b781-cf4d490debf8") : secret "samples-operator-tls" not found Jul 27 21:05:28.377130 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:28.377098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:28.377280 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:28.377261 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 21:05:28.377337 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:28.377328 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert podName:e7cae463-d4e7-489a-8db9-a51e2976c563 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:36.377313301 +0000 UTC m=+61.320334309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cj8mw" (UID: "e7cae463-d4e7-489a-8db9-a51e2976c563") : secret "networking-console-plugin-cert" not found Jul 27 21:05:28.478446 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:28.478400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:28.478599 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:28.478470 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:28.478599 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:28.478540 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:28.478678 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:28.478596 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:28.478678 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:28.478611 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:30.47859436 +0000 UTC m=+55.421615368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:28.478678 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:28.478669 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:30.478656097 +0000 UTC m=+55.421677113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : configmap "kube-rbac-proxy" not found Jul 27 21:05:29.278673 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:29.278648 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52fqc_f6a58687-1aed-4540-ba0e-c4f32ada0330/dns-node-resolver/0.log" Jul 27 21:05:30.479117 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:30.479089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-thftq_23060fe1-e58e-47b8-b213-1e259ef3b79c/node-ca/0.log" Jul 27 21:05:30.493603 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:30.493577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:30.493774 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:30.493622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:30.493774 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:30.493694 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:30.493774 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:30.493742 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:30.493906 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:30.493803 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:34.493784098 +0000 UTC m=+59.436805127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:30.493906 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:30.493824 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:34.493813467 +0000 UTC m=+59.436834477 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : configmap "kube-rbac-proxy" not found Jul 27 21:05:30.749060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:30.748965 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:30.749060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:30.749051 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:30.749380 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:30.749368 2575 scope.go:117] "RemoveContainer" containerID="8589cb9bdd23f11aae29f2e19827add2137640879dbb9efd72baf200b397d530" Jul 27 21:05:30.749547 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:30.749527 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-9lh9h_openshift-console-operator(f4357648-98b8-4ce0-8ddc-029955ffeabb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" podUID="f4357648-98b8-4ce0-8ddc-029955ffeabb" Jul 27 21:05:31.480318 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:31.480283 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rw4mc_33ed798f-d12c-4ca1-8ed5-c96de1ba18de/serve-healthcheck-canary/0.log" Jul 27 21:05:31.679599 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:31.679570 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-zqg5w_eca792b6-734b-4293-b98b-909faf986dfc/migrator/0.log" Jul 27 21:05:31.879303 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:31.879234 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-zqg5w_eca792b6-734b-4293-b98b-909faf986dfc/graceful-termination/0.log" Jul 27 21:05:32.082249 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:32.082207 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc_d65d11be-b256-44ef-a27a-cb191debeb86/kube-storage-version-migrator-operator/0.log" Jul 27 21:05:34.525239 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:34.525205 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:34.525239 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:34.525244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:34.525727 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:34.525329 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 21:05:34.525727 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:34.525372 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:34.525727 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:34.525380 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:42.525367022 +0000 UTC m=+67.468388030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : configmap "kube-rbac-proxy" not found Jul 27 21:05:34.525727 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:34.525475 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:42.525454418 +0000 UTC m=+67.468475425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:35.866300 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:35.866266 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnlqv" Jul 27 21:05:36.338889 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:36.338843 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:36.341715 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:36.341691 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/876a868a-99b3-421a-b781-cf4d490debf8-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qrs5h\" (UID: \"876a868a-99b3-421a-b781-cf4d490debf8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:36.366644 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:36.366620 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-fk5tp\"" Jul 27 21:05:36.374164 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:36.374146 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" Jul 27 21:05:36.439459 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:36.439392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:36.439638 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:36.439621 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 27 21:05:36.439705 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:36.439695 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert podName:e7cae463-d4e7-489a-8db9-a51e2976c563 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:52.439679617 +0000 UTC m=+77.382700624 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-cj8mw" (UID: "e7cae463-d4e7-489a-8db9-a51e2976c563") : secret "networking-console-plugin-cert" not found Jul 27 21:05:36.514101 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:36.514071 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h"] Jul 27 21:05:36.962378 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:36.962347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" event={"ID":"876a868a-99b3-421a-b781-cf4d490debf8","Type":"ContainerStarted","Data":"63d61c78b6d27e7747a4fa7bc00301cf1f0e52671381d6d90d931cf257d5f3b8"} Jul 27 21:05:38.971277 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:38.971239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" event={"ID":"876a868a-99b3-421a-b781-cf4d490debf8","Type":"ContainerStarted","Data":"ab9a6fcb8a451579ce949a6cfb226f0591652e13319db4a8baa1866d490db5ae"} Jul 27 21:05:38.971788 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:38.971321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" event={"ID":"876a868a-99b3-421a-b781-cf4d490debf8","Type":"ContainerStarted","Data":"27d4af4e7d791feb4275e605187de09417f3ffa4e1baa86c921b00b219fb7597"} Jul 27 21:05:38.993173 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:38.993123 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qrs5h" podStartSLOduration=17.428824692 podStartE2EDuration="18.993108667s" totalImagesPullingTime="1.564283975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:38.992528067 +0000 UTC m=+63.935549093" watchObservedRunningTime="2026-07-27 21:05:38.993108667 +0000 UTC m=+63.936129674" Jul 27 21:05:41.278586 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.278544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:41.278975 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.278601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:41.281696 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.281678 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 21:05:41.282759 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.282745 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 21:05:41.291091 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.291059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a22b8bbf-dcd5-4856-ba68-ee02abe770b7-original-pull-secret\") pod \"global-pull-secret-syncer-7sbtn\" (UID: \"a22b8bbf-dcd5-4856-ba68-ee02abe770b7\") " pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:41.291091 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.291085 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e54f19-f7c4-4828-9333-7f61dacd4781-metrics-certs\") pod \"network-metrics-daemon-fk22f\" (UID: \"56e54f19-f7c4-4828-9333-7f61dacd4781\") " pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:41.379805 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.379763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:41.380485 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.380464 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r4zfp\"" Jul 27 21:05:41.383087 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.383072 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 21:05:41.385023 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.385008 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7sbtn" Jul 27 21:05:41.388155 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.388134 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fk22f" Jul 27 21:05:41.392992 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.392979 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 21:05:41.403059 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.403031 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc95z\" (UniqueName: \"kubernetes.io/projected/29b4c36b-f1cc-4e94-8f69-ba1141da6f41-kube-api-access-mc95z\") pod \"network-check-target-26hcs\" (UID: \"29b4c36b-f1cc-4e94-8f69-ba1141da6f41\") " pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:41.542783 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.542704 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7sbtn"] Jul 27 21:05:41.546314 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:41.546282 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22b8bbf_dcd5_4856_ba68_ee02abe770b7.slice/crio-91ad83e7660b88ea82b54c6a2e38cc88ac2f147cdb6a875b6205ea4b54ee6715 WatchSource:0}: Error finding container 91ad83e7660b88ea82b54c6a2e38cc88ac2f147cdb6a875b6205ea4b54ee6715: Status 404 returned error can't find the container with id 91ad83e7660b88ea82b54c6a2e38cc88ac2f147cdb6a875b6205ea4b54ee6715 Jul 27 21:05:41.565943 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.565920 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fk22f"] Jul 27 21:05:41.568530 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:41.568495 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e54f19_f7c4_4828_9333_7f61dacd4781.slice/crio-770224466df6ce28c1648bec85490857457465cd027076b0fdaa03e6a869c443 WatchSource:0}: Error finding container 770224466df6ce28c1648bec85490857457465cd027076b0fdaa03e6a869c443: Status 404 returned error can't find the container with id 770224466df6ce28c1648bec85490857457465cd027076b0fdaa03e6a869c443 Jul 27 21:05:41.693412 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.693381 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5l9j\"" Jul 27 21:05:41.701370 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.701349 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:41.782690 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.782417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:41.785933 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.785909 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b8f52aa-bdb5-4a39-9233-df881ec8d638-metrics-tls\") pod \"dns-default-cpc2t\" (UID: \"5b8f52aa-bdb5-4a39-9233-df881ec8d638\") " pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:41.833072 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.833052 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26hcs"] Jul 27 21:05:41.835592 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:41.835566 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b4c36b_f1cc_4e94_8f69_ba1141da6f41.slice/crio-3dc8d6995f790f1d830e51f49d19863faed8feb7c19d0390784ceb08f6a39720 WatchSource:0}: Error finding container 3dc8d6995f790f1d830e51f49d19863faed8feb7c19d0390784ceb08f6a39720: Status 404 returned error can't find the container with id 3dc8d6995f790f1d830e51f49d19863faed8feb7c19d0390784ceb08f6a39720 Jul 27 21:05:41.983484 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.983268 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26hcs" event={"ID":"29b4c36b-f1cc-4e94-8f69-ba1141da6f41","Type":"ContainerStarted","Data":"3dc8d6995f790f1d830e51f49d19863faed8feb7c19d0390784ceb08f6a39720"} Jul 27 21:05:41.984842 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.984804 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7sbtn" event={"ID":"a22b8bbf-dcd5-4856-ba68-ee02abe770b7","Type":"ContainerStarted","Data":"91ad83e7660b88ea82b54c6a2e38cc88ac2f147cdb6a875b6205ea4b54ee6715"} Jul 27 21:05:41.986029 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:41.985996 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fk22f" event={"ID":"56e54f19-f7c4-4828-9333-7f61dacd4781","Type":"ContainerStarted","Data":"770224466df6ce28c1648bec85490857457465cd027076b0fdaa03e6a869c443"} Jul 27 21:05:42.020894 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:42.020859 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k6b4w\"" Jul 27 21:05:42.027696 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:42.027661 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:42.193767 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:42.193683 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cpc2t"] Jul 27 21:05:42.198588 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:42.198556 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b8f52aa_bdb5_4a39_9233_df881ec8d638.slice/crio-eef35dea610ecc3dff9de507fa9a89e2f426470d7074440b096fabed262873e2 WatchSource:0}: Error finding container eef35dea610ecc3dff9de507fa9a89e2f426470d7074440b096fabed262873e2: Status 404 returned error can't find the container with id eef35dea610ecc3dff9de507fa9a89e2f426470d7074440b096fabed262873e2 Jul 27 21:05:42.589134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:42.588524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:42.589134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:42.588571 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:42.589134 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:42.588651 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 21:05:42.589134 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:05:42.588717 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls podName:f5caac3c-73de-4b2e-a8d9-fae91c6522b2 nodeName:}" failed. No retries permitted until 2026-07-27 21:05:58.588697099 +0000 UTC m=+83.531718106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c66x5" (UID: "f5caac3c-73de-4b2e-a8d9-fae91c6522b2") : secret "insights-runtime-extractor-tls" not found Jul 27 21:05:42.589134 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:42.589090 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:42.992602 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:42.992565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fk22f" event={"ID":"56e54f19-f7c4-4828-9333-7f61dacd4781","Type":"ContainerStarted","Data":"7fd9a7f307b9e3eec397f10f4f5fa387d1356661040a94a5a347f29a50acfc44"} Jul 27 21:05:42.992789 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:42.992631 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fk22f" event={"ID":"56e54f19-f7c4-4828-9333-7f61dacd4781","Type":"ContainerStarted","Data":"c3ba0a29b1bde1fb748cbc8637a9dfb07db989947c99353e8c609e01b3f0f46b"} Jul 27 21:05:42.994318 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:42.994291 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cpc2t" event={"ID":"5b8f52aa-bdb5-4a39-9233-df881ec8d638","Type":"ContainerStarted","Data":"eef35dea610ecc3dff9de507fa9a89e2f426470d7074440b096fabed262873e2"} Jul 27 21:05:43.009925 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:43.009879 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fk22f" podStartSLOduration=67.102234691 podStartE2EDuration="1m8.009861963s" totalImagesPullingTime="907.627272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:43.009557164 +0000 UTC m=+67.952578194" watchObservedRunningTime="2026-07-27 21:05:43.009861963 +0000 UTC m=+67.952882992" Jul 27 21:05:44.665113 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:44.665077 2575 scope.go:117] "RemoveContainer" containerID="8589cb9bdd23f11aae29f2e19827add2137640879dbb9efd72baf200b397d530" Jul 27 21:05:45.005057 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:45.004976 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cpc2t" event={"ID":"5b8f52aa-bdb5-4a39-9233-df881ec8d638","Type":"ContainerStarted","Data":"402cf8146f032fb403d8fd0b8447931f6f80068ac6fb43029d79f7afda79c14e"} Jul 27 21:05:47.014573 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.014545 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:05:47.015019 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.014631 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" event={"ID":"f4357648-98b8-4ce0-8ddc-029955ffeabb","Type":"ContainerStarted","Data":"0636d973c15136d4b05397320c5b7cdafaf2fda837b63de7c832529b7ebfcb03"} Jul 27 21:05:47.015019 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.014907 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:47.016607 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.016383 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26hcs" event={"ID":"29b4c36b-f1cc-4e94-8f69-ba1141da6f41","Type":"ContainerStarted","Data":"06e27a72011e43bc2f72056afa21f7beaf310fb7985a69f6e140408e36cfa64f"} Jul 27 21:05:47.016607 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.016484 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:05:47.017895 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.017876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7sbtn" event={"ID":"a22b8bbf-dcd5-4856-ba68-ee02abe770b7","Type":"ContainerStarted","Data":"0ace0da573aaf89cef2ed9673a4fbad78654b22ec80d3e50ca79e4ffc29bd7cb"} Jul 27 21:05:47.019705 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.019682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cpc2t" event={"ID":"5b8f52aa-bdb5-4a39-9233-df881ec8d638","Type":"ContainerStarted","Data":"3c548c25201370cca3253e0a976a9eb2dc80eb83f599e00e1029a601000286e0"} Jul 27 21:05:47.019819 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.019807 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:47.037858 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.037807 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" podStartSLOduration=24.020231199 podStartE2EDuration="27.037790835s" totalImagesPullingTime="3.017559636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:47.036775022 +0000 UTC m=+71.979796053" watchObservedRunningTime="2026-07-27 21:05:47.037790835 +0000 UTC m=+71.980811845" Jul 27 21:05:47.054173 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.054138 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-26hcs" podStartSLOduration=67.238159395 podStartE2EDuration="1m12.054125913s" totalImagesPullingTime="4.815966518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:47.054090954 +0000 UTC m=+71.997111984" watchObservedRunningTime="2026-07-27 21:05:47.054125913 +0000 UTC m=+71.997146942" Jul 27 21:05:47.075171 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.075128 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cpc2t" podStartSLOduration=36.037536702 podStartE2EDuration="38.075113626s" totalImagesPullingTime="2.037576924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:47.074372798 +0000 UTC m=+72.017393827" watchObservedRunningTime="2026-07-27 21:05:47.075113626 +0000 UTC m=+72.018134655" Jul 27 21:05:47.096844 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.096787 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7sbtn" podStartSLOduration=66.985744137 podStartE2EDuration="1m12.09676779s" totalImagesPullingTime="5.111023653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:47.094995879 +0000 UTC m=+72.038016924" watchObservedRunningTime="2026-07-27 21:05:47.09676779 +0000 UTC m=+72.039788820" Jul 27 21:05:47.253896 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:47.253864 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-9lh9h" Jul 27 21:05:52.461242 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.461206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:52.463739 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.463707 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7cae463-d4e7-489a-8db9-a51e2976c563-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-cj8mw\" (UID: \"e7cae463-d4e7-489a-8db9-a51e2976c563\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:52.478288 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.478260 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf"] Jul 27 21:05:52.483387 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.483344 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.488605 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.488579 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 21:05:52.488605 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.488579 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 27 21:05:52.489355 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.489331 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 27 21:05:52.489891 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.489869 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 21:05:52.490590 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.490381 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 27 21:05:52.490590 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.490543 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 27 21:05:52.491315 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.491299 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 21:05:52.526809 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.526775 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf"] Jul 27 21:05:52.562003 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.561969 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-ca\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.562003 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.562006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.562271 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.562036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b13ae6-79e5-44a6-be51-9abe46aacb4b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.562271 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.562101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-hub\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.562271 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.562241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mjpx\" (UniqueName: \"kubernetes.io/projected/31b13ae6-79e5-44a6-be51-9abe46aacb4b-kube-api-access-9mjpx\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.562394 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.562281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.662791 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.662751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b13ae6-79e5-44a6-be51-9abe46aacb4b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.662969 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.662800 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-hub\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.662969 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.662854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mjpx\" (UniqueName: \"kubernetes.io/projected/31b13ae6-79e5-44a6-be51-9abe46aacb4b-kube-api-access-9mjpx\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.662969 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.662882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.663143 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.663025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-ca\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.663143 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.663066 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.663620 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.663583 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b13ae6-79e5-44a6-be51-9abe46aacb4b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.665821 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.665798 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.665943 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.665926 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-ca\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.666012 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.665989 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.666077 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.666060 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/31b13ae6-79e5-44a6-be51-9abe46aacb4b-hub\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.677180 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.677156 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mjpx\" (UniqueName: \"kubernetes.io/projected/31b13ae6-79e5-44a6-be51-9abe46aacb4b-kube-api-access-9mjpx\") pod \"cluster-proxy-proxy-agent-5d56c4b79c-qkrpf\" (UID: \"31b13ae6-79e5-44a6-be51-9abe46aacb4b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.697955 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.697920 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h8jbb\"" Jul 27 21:05:52.706417 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.706395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" Jul 27 21:05:52.809119 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.809081 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" Jul 27 21:05:52.859538 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.859394 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw"] Jul 27 21:05:52.861393 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:52.861366 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7cae463_d4e7_489a_8db9_a51e2976c563.slice/crio-65f430010d28bb7c8bacbc3e45a977fb388ef60984826ccc7391ff0801d1ab47 WatchSource:0}: Error finding container 65f430010d28bb7c8bacbc3e45a977fb388ef60984826ccc7391ff0801d1ab47: Status 404 returned error can't find the container with id 65f430010d28bb7c8bacbc3e45a977fb388ef60984826ccc7391ff0801d1ab47 Jul 27 21:05:52.996058 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:52.996028 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf"] Jul 27 21:05:52.996781 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:52.996758 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31b13ae6_79e5_44a6_be51_9abe46aacb4b.slice/crio-19f95273f317bf1590c40f424825d1f525a40fb794e1fd93ffcd4e6d20969896 WatchSource:0}: Error finding container 19f95273f317bf1590c40f424825d1f525a40fb794e1fd93ffcd4e6d20969896: Status 404 returned error can't find the container with id 19f95273f317bf1590c40f424825d1f525a40fb794e1fd93ffcd4e6d20969896 Jul 27 21:05:53.039115 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:53.039079 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" event={"ID":"31b13ae6-79e5-44a6-be51-9abe46aacb4b","Type":"ContainerStarted","Data":"19f95273f317bf1590c40f424825d1f525a40fb794e1fd93ffcd4e6d20969896"} Jul 27 21:05:53.040181 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:53.040158 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" event={"ID":"e7cae463-d4e7-489a-8db9-a51e2976c563","Type":"ContainerStarted","Data":"65f430010d28bb7c8bacbc3e45a977fb388ef60984826ccc7391ff0801d1ab47"} Jul 27 21:05:54.025566 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:54.025534 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cpc2t" Jul 27 21:05:55.050513 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:55.050468 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" event={"ID":"e7cae463-d4e7-489a-8db9-a51e2976c563","Type":"ContainerStarted","Data":"76d4869eb96e38f813eae8913197128e365cb4c9fb4dc6bd72595e3a6c1ccdaa"} Jul 27 21:05:55.071256 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:55.071022 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-cj8mw" podStartSLOduration=33.871397663 podStartE2EDuration="35.070977292s" totalImagesPullingTime="1.199579629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:55.070889084 +0000 UTC m=+80.013910114" watchObservedRunningTime="2026-07-27 21:05:55.070977292 +0000 UTC m=+80.013998322" Jul 27 21:05:58.064589 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:58.064551 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" event={"ID":"31b13ae6-79e5-44a6-be51-9abe46aacb4b","Type":"ContainerStarted","Data":"89693358f269d2e470b285a8aebabe8e4e198929fc43ae7fbd23c6a3f0c2fcdc"} Jul 27 21:05:58.064589 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:58.064594 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" event={"ID":"31b13ae6-79e5-44a6-be51-9abe46aacb4b","Type":"ContainerStarted","Data":"22adf99cad2d6f270480d9658119015d678c31abfa9df8721ec3429ed858b060"} Jul 27 21:05:58.065010 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:58.064606 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" event={"ID":"31b13ae6-79e5-44a6-be51-9abe46aacb4b","Type":"ContainerStarted","Data":"7c8cf97e4a6238556ced712a71181f18af96cf925e67eb1416d00a3ea8ef341f"} Jul 27 21:05:58.091403 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:58.091354 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d56c4b79c-qkrpf" podStartSLOduration=2.079040557 podStartE2EDuration="6.091328241s" totalImagesPullingTime="4.012287684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:05:58.090642919 +0000 UTC m=+83.033663948" watchObservedRunningTime="2026-07-27 21:05:58.091328241 +0000 UTC m=+83.034349309" Jul 27 21:05:58.613633 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:58.613589 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:58.616119 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:58.616091 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5caac3c-73de-4b2e-a8d9-fae91c6522b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c66x5\" (UID: \"f5caac3c-73de-4b2e-a8d9-fae91c6522b2\") " pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:58.825549 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:58.825513 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-j726j\"" Jul 27 21:05:58.832957 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:58.832939 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c66x5" Jul 27 21:05:58.983296 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:58.983252 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c66x5"] Jul 27 21:05:58.985919 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:05:58.985891 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5caac3c_73de_4b2e_a8d9_fae91c6522b2.slice/crio-4a76a9e9ab68d2237f0cad9064964a9fde05de35c033cb6c1a7de6eaa64a5e68 WatchSource:0}: Error finding container 4a76a9e9ab68d2237f0cad9064964a9fde05de35c033cb6c1a7de6eaa64a5e68: Status 404 returned error can't find the container with id 4a76a9e9ab68d2237f0cad9064964a9fde05de35c033cb6c1a7de6eaa64a5e68 Jul 27 21:05:59.069188 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:05:59.069149 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c66x5" event={"ID":"f5caac3c-73de-4b2e-a8d9-fae91c6522b2","Type":"ContainerStarted","Data":"4a76a9e9ab68d2237f0cad9064964a9fde05de35c033cb6c1a7de6eaa64a5e68"} Jul 27 21:06:03.353228 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.353196 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2k2pt"] Jul 27 21:06:03.360065 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.360038 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.362678 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.362655 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 21:06:03.362816 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.362764 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rsf9d\"" Jul 27 21:06:03.363045 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.363031 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 21:06:03.363643 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.363500 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 21:06:03.364175 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.364156 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 21:06:03.364261 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.364230 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 21:06:03.364459 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.364440 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 21:06:03.449569 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.449526 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-wtmp\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.449753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.449581 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.449753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.449605 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-tls\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.449753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.449689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.449753 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.449746 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5428\" (UniqueName: \"kubernetes.io/projected/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-kube-api-access-r5428\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.449929 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.449767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-metrics-client-ca\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.449929 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.449803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-root\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.449929 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.449833 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-sys\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.449929 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.449856 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-textfile\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.550922 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.550879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-textfile\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551091 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.550933 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-wtmp\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551091 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.550970 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551091 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.550997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-tls\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551255 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551127 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551255 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5428\" (UniqueName: \"kubernetes.io/projected/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-kube-api-access-r5428\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551255 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551222 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-metrics-client-ca\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551255 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:06:03.551225 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 21:06:03.551404 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-root\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551404 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:06:03.551298 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-tls podName:fcfa4367-9047-4e4c-b3f3-34c1c937e0c6 nodeName:}" failed. No retries permitted until 2026-07-27 21:06:04.051276852 +0000 UTC m=+88.994297859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-tls") pod "node-exporter-2k2pt" (UID: "fcfa4367-9047-4e4c-b3f3-34c1c937e0c6") : secret "node-exporter-tls" not found Jul 27 21:06:03.551404 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551301 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-textfile\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551404 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551314 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-root\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551404 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-wtmp\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551404 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-sys\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551720 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551459 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-sys\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551720 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551650 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.551940 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.551920 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-metrics-client-ca\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.553899 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.553877 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:03.562526 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:03.562500 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5428\" (UniqueName: \"kubernetes.io/projected/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-kube-api-access-r5428\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:04.056005 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:04.055972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-tls\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:04.056190 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:06:04.056134 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 27 21:06:04.056249 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:06:04.056195 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-tls podName:fcfa4367-9047-4e4c-b3f3-34c1c937e0c6 nodeName:}" failed. No retries permitted until 2026-07-27 21:06:05.056180583 +0000 UTC m=+89.999201593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-tls") pod "node-exporter-2k2pt" (UID: "fcfa4367-9047-4e4c-b3f3-34c1c937e0c6") : secret "node-exporter-tls" not found Jul 27 21:06:04.090390 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:04.090306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c66x5" event={"ID":"f5caac3c-73de-4b2e-a8d9-fae91c6522b2","Type":"ContainerStarted","Data":"7fa3da811c2a26c937597d20382377ea1704fd578e9a185e2fd72ff63077eca1"} Jul 27 21:06:05.064605 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:05.064568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-tls\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:05.067381 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:05.067357 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fcfa4367-9047-4e4c-b3f3-34c1c937e0c6-node-exporter-tls\") pod \"node-exporter-2k2pt\" (UID: \"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6\") " pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:05.171523 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:05.171470 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2k2pt" Jul 27 21:06:05.184533 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:06:05.184481 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfa4367_9047_4e4c_b3f3_34c1c937e0c6.slice/crio-db5657fdafe64e7f595d2cc4b1ebdb792c4e55a165e583f7198f45b764a9850b WatchSource:0}: Error finding container db5657fdafe64e7f595d2cc4b1ebdb792c4e55a165e583f7198f45b764a9850b: Status 404 returned error can't find the container with id db5657fdafe64e7f595d2cc4b1ebdb792c4e55a165e583f7198f45b764a9850b Jul 27 21:06:06.099199 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:06.099158 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2k2pt" event={"ID":"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6","Type":"ContainerStarted","Data":"db5657fdafe64e7f595d2cc4b1ebdb792c4e55a165e583f7198f45b764a9850b"} Jul 27 21:06:08.108627 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:08.108585 2575 generic.go:356] "Generic (PLEG): container finished" podID="fcfa4367-9047-4e4c-b3f3-34c1c937e0c6" containerID="a003ac219454bb2c9cd9637628073468aa519e17ef6ee527553d5b5f1e5dd1ff" exitCode=0 Jul 27 21:06:08.109080 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:08.108695 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2k2pt" event={"ID":"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6","Type":"ContainerDied","Data":"a003ac219454bb2c9cd9637628073468aa519e17ef6ee527553d5b5f1e5dd1ff"} Jul 27 21:06:08.111016 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:08.110993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c66x5" event={"ID":"f5caac3c-73de-4b2e-a8d9-fae91c6522b2","Type":"ContainerStarted","Data":"d743bcca82c8e9b4481eb353fcc44d2cda8d29a115c163e630a89ee82f7e69eb"} Jul 27 21:06:09.117399 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.117354 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2k2pt" event={"ID":"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6","Type":"ContainerStarted","Data":"fbd87261ce0d68e90d3adc8885763c9051209ec463baa782e5725d0b0ebc546f"} Jul 27 21:06:09.117830 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.117449 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2k2pt" event={"ID":"fcfa4367-9047-4e4c-b3f3-34c1c937e0c6","Type":"ContainerStarted","Data":"dbc70597b853a6e2fa0869af2c5c79b184c838961dfe0213be9cd38b57922b47"} Jul 27 21:06:09.140372 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.140310 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2k2pt" podStartSLOduration=3.593655551 podStartE2EDuration="6.140288241s" totalImagesPullingTime="2.472937347s" totalInitContainerRuntime="73.695343ms" isStatefulPod=true podCreationTimestamp="2026-07-27 21:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:09.138113646 +0000 UTC m=+94.081134675" watchObservedRunningTime="2026-07-27 21:06:09.140288241 +0000 UTC m=+94.083309271" Jul 27 21:06:09.788931 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.788895 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 21:06:09.795439 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.795397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.798879 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.798858 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 27 21:06:09.804475 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.804447 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2qfpk\"" Jul 27 21:06:09.804625 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.804544 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 27 21:06:09.804625 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.804451 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 27 21:06:09.804750 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.804457 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 27 21:06:09.804824 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.804802 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 27 21:06:09.804898 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.804857 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 27 21:06:09.804955 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.804929 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 27 21:06:09.806012 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.805873 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 27 21:06:09.806012 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.805886 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 27 21:06:09.806012 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.805909 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 27 21:06:09.806012 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.805952 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 27 21:06:09.806287 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.806076 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 27 21:06:09.806342 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.806330 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8lvp9dd2112or\"" Jul 27 21:06:09.807965 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.807940 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 27 21:06:09.811488 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.811466 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 27 21:06:09.814293 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.814273 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 27 21:06:09.823438 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.823398 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 21:06:09.907350 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907313 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907536 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907363 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907536 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907457 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-config\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907536 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74338f19-47e1-4414-a5b5-0cc6ec5790ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907707 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907563 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907707 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907605 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907707 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907853 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907735 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907853 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907853 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907791 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.907853 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907838 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.908060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907885 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flfgg\" (UniqueName: \"kubernetes.io/projected/74338f19-47e1-4414-a5b5-0cc6ec5790ac-kube-api-access-flfgg\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.908060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907910 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.908060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.908060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907959 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.908060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.907988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.908060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.908012 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74338f19-47e1-4414-a5b5-0cc6ec5790ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.908060 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.908042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.908345 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.908067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:09.908345 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:09.908095 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009043 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.008992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009043 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009293 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009293 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flfgg\" (UniqueName: \"kubernetes.io/projected/74338f19-47e1-4414-a5b5-0cc6ec5790ac-kube-api-access-flfgg\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009293 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009271 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009477 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009477 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009477 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009356 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009477 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009383 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74338f19-47e1-4414-a5b5-0cc6ec5790ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009477 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009444 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009477 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009474 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009584 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009623 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-config\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74338f19-47e1-4414-a5b5-0cc6ec5790ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009723 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.009778 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.010144 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009817 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.010144 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.009827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.010252 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.010202 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.010406 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.010384 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.011359 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.010740 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.014070 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.014032 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.014520 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.014494 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.014934 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.014907 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.014934 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.014940 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.015202 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.015180 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/74338f19-47e1-4414-a5b5-0cc6ec5790ac-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.015202 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.015195 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.015700 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.015596 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.015700 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.015628 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/74338f19-47e1-4414-a5b5-0cc6ec5790ac-config-out\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.016666 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.016070 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/74338f19-47e1-4414-a5b5-0cc6ec5790ac-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.016666 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.016328 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.017356 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.017333 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/74338f19-47e1-4414-a5b5-0cc6ec5790ac-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.018659 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.018610 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.019053 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.019030 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-web-config\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.019502 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.019485 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.020162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.020145 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/74338f19-47e1-4414-a5b5-0cc6ec5790ac-config\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.027886 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.027850 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flfgg\" (UniqueName: \"kubernetes.io/projected/74338f19-47e1-4414-a5b5-0cc6ec5790ac-kube-api-access-flfgg\") pod \"prometheus-k8s-0\" (UID: \"74338f19-47e1-4414-a5b5-0cc6ec5790ac\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:10.107946 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:10.107870 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:11.273239 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:11.273217 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 27 21:06:11.275015 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:06:11.274992 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74338f19_47e1_4414_a5b5_0cc6ec5790ac.slice/crio-e1c8bb03a494cc1c078527e38ffd2af14e29aabfc4d3e00a90db81cdd95f998e WatchSource:0}: Error finding container e1c8bb03a494cc1c078527e38ffd2af14e29aabfc4d3e00a90db81cdd95f998e: Status 404 returned error can't find the container with id e1c8bb03a494cc1c078527e38ffd2af14e29aabfc4d3e00a90db81cdd95f998e Jul 27 21:06:12.136156 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:12.136121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c66x5" event={"ID":"f5caac3c-73de-4b2e-a8d9-fae91c6522b2","Type":"ContainerStarted","Data":"16302a158873bc85a7c10c78a331003009227fe4dbef17faecbc85da9cf1b0af"} Jul 27 21:06:12.137606 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:12.137570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74338f19-47e1-4414-a5b5-0cc6ec5790ac","Type":"ContainerStarted","Data":"e1c8bb03a494cc1c078527e38ffd2af14e29aabfc4d3e00a90db81cdd95f998e"} Jul 27 21:06:12.158203 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:12.158147 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c66x5" podStartSLOduration=34.113218023 podStartE2EDuration="46.158132752s" totalImagesPullingTime="12.044914729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:05:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:12.157010556 +0000 UTC m=+97.100031612" watchObservedRunningTime="2026-07-27 21:06:12.158132752 +0000 UTC m=+97.101153781" Jul 27 21:06:13.143216 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:13.143173 2575 generic.go:356] "Generic (PLEG): container finished" podID="74338f19-47e1-4414-a5b5-0cc6ec5790ac" containerID="7fb061137c29f6007208bb32b97a1d8dfcdab5104e4628e013ab33706523bf8f" exitCode=0 Jul 27 21:06:13.143693 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:13.143265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74338f19-47e1-4414-a5b5-0cc6ec5790ac","Type":"ContainerDied","Data":"7fb061137c29f6007208bb32b97a1d8dfcdab5104e4628e013ab33706523bf8f"} Jul 27 21:06:17.160682 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:17.160640 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74338f19-47e1-4414-a5b5-0cc6ec5790ac","Type":"ContainerStarted","Data":"927ab181efbfd16bfa160dbf5b6b131060d8bf9f3e18d1618c63076c1c4a4f88"} Jul 27 21:06:17.161170 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:17.160718 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74338f19-47e1-4414-a5b5-0cc6ec5790ac","Type":"ContainerStarted","Data":"ab8244ab80ddc45a18adabf056d7ebb1405629c1f107a086f595b117803f3815"} Jul 27 21:06:18.026385 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:18.026349 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-26hcs" Jul 27 21:06:19.170729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:19.170698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74338f19-47e1-4414-a5b5-0cc6ec5790ac","Type":"ContainerStarted","Data":"700fd1f615ef625aebf10bf281a96489cce5d54076615c35a52a6fb2b54263b1"} Jul 27 21:06:19.171051 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:19.170788 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74338f19-47e1-4414-a5b5-0cc6ec5790ac","Type":"ContainerStarted","Data":"98dba09ff598a1584b8b31af9dc039319936c3b0768051e8040f3774ebf3faca"} Jul 27 21:06:19.171051 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:19.170815 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74338f19-47e1-4414-a5b5-0cc6ec5790ac","Type":"ContainerStarted","Data":"544b609fdc1a12b6456a6fcc6e3a17d08cddcf93ea24f49bd5220529b8198181"} Jul 27 21:06:20.177897 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:20.177861 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"74338f19-47e1-4414-a5b5-0cc6ec5790ac","Type":"ContainerStarted","Data":"abc6624840fe0792fade856bd0f9f8ac7829434ac818400397b18852e99b0a98"} Jul 27 21:06:25.108797 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:25.108751 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:06:40.251095 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:40.251059 2575 generic.go:356] "Generic (PLEG): container finished" podID="d65d11be-b256-44ef-a27a-cb191debeb86" containerID="e85c29da6f455c6c5ea0f4ff2f4a626c317c57fe27448beeb72a19db7da933ca" exitCode=0 Jul 27 21:06:40.251541 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:40.251103 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" event={"ID":"d65d11be-b256-44ef-a27a-cb191debeb86","Type":"ContainerDied","Data":"e85c29da6f455c6c5ea0f4ff2f4a626c317c57fe27448beeb72a19db7da933ca"} Jul 27 21:06:40.251541 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:40.251406 2575 scope.go:117] "RemoveContainer" containerID="e85c29da6f455c6c5ea0f4ff2f4a626c317c57fe27448beeb72a19db7da933ca" Jul 27 21:06:40.268924 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:40.268863 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=24.714181845 podStartE2EDuration="31.268839682s" totalImagesPullingTime="6.535979966s" totalInitContainerRuntime="18.677871ms" isStatefulPod=false podCreationTimestamp="2026-07-27 21:06:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:06:20.234175963 +0000 UTC m=+105.177196993" watchObservedRunningTime="2026-07-27 21:06:40.268839682 +0000 UTC m=+125.211860712" Jul 27 21:06:41.256244 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:41.256209 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc" event={"ID":"d65d11be-b256-44ef-a27a-cb191debeb86","Type":"ContainerStarted","Data":"49f2bb89af71c990a36343a38e0078260a4eb9b3fd4a90bb789c5b4775729fcd"} Jul 27 21:06:57.566548 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:06:57.566516 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rw4mc_33ed798f-d12c-4ca1-8ed5-c96de1ba18de/serve-healthcheck-canary/0.log" Jul 27 21:07:10.108325 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:07:10.108286 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:07:10.132211 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:07:10.132185 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:07:10.382117 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:07:10.382042 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 27 21:09:35.467975 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:09:35.467945 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:09:35.471845 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:09:35.471819 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:09:35.473953 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:09:35.473936 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:09:35.478467 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:09:35.478450 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:09:35.478597 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:09:35.478538 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 21:13:03.063485 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.063445 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-2dzhf"] Jul 27 21:13:03.066721 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.066698 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-2dzhf" Jul 27 21:13:03.069627 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.069601 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 27 21:13:03.069830 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.069818 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-95wp8\"" Jul 27 21:13:03.069881 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.069857 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 27 21:13:03.070879 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.070862 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 27 21:13:03.076003 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.075985 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-2dzhf"] Jul 27 21:13:03.102444 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.102387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpsg9\" (UniqueName: \"kubernetes.io/projected/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-kube-api-access-bpsg9\") pod \"s3-init-2dzhf\" (UID: \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\") " pod="kserve/s3-init-2dzhf" Jul 27 21:13:03.102444 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.102450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-model-cache\") pod \"s3-init-2dzhf\" (UID: \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\") " pod="kserve/s3-init-2dzhf" Jul 27 21:13:03.203081 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.203050 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpsg9\" (UniqueName: \"kubernetes.io/projected/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-kube-api-access-bpsg9\") pod \"s3-init-2dzhf\" (UID: \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\") " pod="kserve/s3-init-2dzhf" Jul 27 21:13:03.203242 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.203094 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-model-cache\") pod \"s3-init-2dzhf\" (UID: \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\") " pod="kserve/s3-init-2dzhf" Jul 27 21:13:03.203549 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.203533 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-model-cache\") pod \"s3-init-2dzhf\" (UID: \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\") " pod="kserve/s3-init-2dzhf" Jul 27 21:13:03.212617 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.212586 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpsg9\" (UniqueName: \"kubernetes.io/projected/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-kube-api-access-bpsg9\") pod \"s3-init-2dzhf\" (UID: \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\") " pod="kserve/s3-init-2dzhf" Jul 27 21:13:03.376845 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.376757 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-2dzhf" Jul 27 21:13:03.507746 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.507709 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-2dzhf"] Jul 27 21:13:03.510403 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:13:03.510375 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51d56a9d_f1da_4dda_aab9_7b20c0cc1633.slice/crio-bae9328331fbfffc041121232ad52835b9307b09d604f0585dc840002936a453 WatchSource:0}: Error finding container bae9328331fbfffc041121232ad52835b9307b09d604f0585dc840002936a453: Status 404 returned error can't find the container with id bae9328331fbfffc041121232ad52835b9307b09d604f0585dc840002936a453 Jul 27 21:13:03.512729 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.512712 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 21:13:03.630631 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:03.630532 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2dzhf" event={"ID":"51d56a9d-f1da-4dda-aab9-7b20c0cc1633","Type":"ContainerStarted","Data":"bae9328331fbfffc041121232ad52835b9307b09d604f0585dc840002936a453"} Jul 27 21:13:07.648412 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:07.648375 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2dzhf" event={"ID":"51d56a9d-f1da-4dda-aab9-7b20c0cc1633","Type":"ContainerStarted","Data":"543279eb7553106ae847603152bcc26da37d6fefccf5045676bfec7c96b43626"} Jul 27 21:13:09.657913 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:09.657883 2575 generic.go:356] "Generic (PLEG): container finished" podID="51d56a9d-f1da-4dda-aab9-7b20c0cc1633" containerID="543279eb7553106ae847603152bcc26da37d6fefccf5045676bfec7c96b43626" exitCode=0 Jul 27 21:13:09.658271 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:09.657954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2dzhf" event={"ID":"51d56a9d-f1da-4dda-aab9-7b20c0cc1633","Type":"ContainerDied","Data":"543279eb7553106ae847603152bcc26da37d6fefccf5045676bfec7c96b43626"} Jul 27 21:13:14.682517 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:14.682479 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2dzhf" event={"ID":"51d56a9d-f1da-4dda-aab9-7b20c0cc1633","Type":"ContainerStarted","Data":"279679b1e631217e30971a60c13ad71c5cf1e21e6b3f756f54b5b5a63fb244e2"} Jul 27 21:13:14.699988 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:13:14.699928 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-2dzhf" podStartSLOduration=1.347521193 podStartE2EDuration="11.699911897s" totalImagesPullingTime="8.656425505s" totalInitContainerRuntime="1.695965199s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:13:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:13:14.699054207 +0000 UTC m=+519.642075248" watchObservedRunningTime="2026-07-27 21:13:14.699911897 +0000 UTC m=+519.642932926" Jul 27 21:14:19.927704 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:19.927664 2575 generic.go:356] "Generic (PLEG): container finished" podID="51d56a9d-f1da-4dda-aab9-7b20c0cc1633" containerID="279679b1e631217e30971a60c13ad71c5cf1e21e6b3f756f54b5b5a63fb244e2" exitCode=0 Jul 27 21:14:19.928198 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:19.927709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2dzhf" event={"ID":"51d56a9d-f1da-4dda-aab9-7b20c0cc1633","Type":"ContainerDied","Data":"279679b1e631217e30971a60c13ad71c5cf1e21e6b3f756f54b5b5a63fb244e2"} Jul 27 21:14:21.053439 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.053402 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-2dzhf" Jul 27 21:14:21.142670 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.142634 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-model-cache\") pod \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\" (UID: \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\") " Jul 27 21:14:21.142857 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.142722 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpsg9\" (UniqueName: \"kubernetes.io/projected/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-kube-api-access-bpsg9\") pod \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\" (UID: \"51d56a9d-f1da-4dda-aab9-7b20c0cc1633\") " Jul 27 21:14:21.145150 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.145109 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-kube-api-access-bpsg9" (OuterVolumeSpecName: "kube-api-access-bpsg9") pod "51d56a9d-f1da-4dda-aab9-7b20c0cc1633" (UID: "51d56a9d-f1da-4dda-aab9-7b20c0cc1633"). InnerVolumeSpecName "kube-api-access-bpsg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:14:21.161237 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.161204 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-model-cache" (OuterVolumeSpecName: "model-cache") pod "51d56a9d-f1da-4dda-aab9-7b20c0cc1633" (UID: "51d56a9d-f1da-4dda-aab9-7b20c0cc1633"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:14:21.243460 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.243358 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpsg9\" (UniqueName: \"kubernetes.io/projected/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-kube-api-access-bpsg9\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:14:21.243460 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.243385 2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51d56a9d-f1da-4dda-aab9-7b20c0cc1633-model-cache\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:14:21.936158 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.936084 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-2dzhf" Jul 27 21:14:21.936158 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.936090 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-2dzhf" event={"ID":"51d56a9d-f1da-4dda-aab9-7b20c0cc1633","Type":"ContainerDied","Data":"bae9328331fbfffc041121232ad52835b9307b09d604f0585dc840002936a453"} Jul 27 21:14:21.936158 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:21.936121 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bae9328331fbfffc041121232ad52835b9307b09d604f0585dc840002936a453" Jul 27 21:14:35.495080 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:35.495050 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:14:35.496275 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:35.496254 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:14:35.498551 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:35.498529 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:14:35.499830 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:14:35.499810 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:19:35.519483 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:19:35.519459 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:19:35.519924 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:19:35.519507 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:19:35.522999 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:19:35.522978 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:19:35.523267 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:19:35.523245 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:24:35.542269 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:24:35.542233 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:24:35.543291 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:24:35.543269 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:24:35.546063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:24:35.546036 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:24:35.547013 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:24:35.546992 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:27:56.450670 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.450633 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5"] Jul 27 21:27:56.451259 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.451042 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d56a9d-f1da-4dda-aab9-7b20c0cc1633" containerName="download-hf-model" Jul 27 21:27:56.451259 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.451060 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d56a9d-f1da-4dda-aab9-7b20c0cc1633" containerName="download-hf-model" Jul 27 21:27:56.451259 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.451072 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d56a9d-f1da-4dda-aab9-7b20c0cc1633" containerName="s3-init" Jul 27 21:27:56.451259 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.451080 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d56a9d-f1da-4dda-aab9-7b20c0cc1633" containerName="s3-init" Jul 27 21:27:56.451259 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.451142 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d56a9d-f1da-4dda-aab9-7b20c0cc1633" containerName="s3-init" Jul 27 21:27:56.454270 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.454247 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.456952 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.456928 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 27 21:27:56.457063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.456933 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 27 21:27:56.457063 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.457031 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cmm8z\"" Jul 27 21:27:56.457170 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.457036 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-kube-rbac-proxy-sar-config\"" Jul 27 21:27:56.457170 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.456990 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-promote-v2-predictor-serving-cert\"" Jul 27 21:27:56.457266 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.457229 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 27 21:27:56.457470 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.457445 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 27 21:27:56.463347 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.463324 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5"] Jul 27 21:27:56.539406 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.539368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.539592 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.539450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thg2b\" (UniqueName: \"kubernetes.io/projected/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-api-access-thg2b\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.539592 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.539480 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.539592 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.539503 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.539592 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.539519 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.639925 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.639892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.640095 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.639944 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thg2b\" (UniqueName: \"kubernetes.io/projected/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-api-access-thg2b\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.640095 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.639976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.640095 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.640006 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.640095 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.640026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.640447 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.640397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kserve-provision-location\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.640755 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.640734 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-rbac-proxy-sar-config\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.640856 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.640770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-cabundle-cert\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.642748 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.642728 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-proxy-tls\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.649523 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.649494 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thg2b\" (UniqueName: \"kubernetes.io/projected/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-api-access-thg2b\") pod \"isvc-canary-promote-v2-predictor-86766c4958-pkjv5\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.766083 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.765993 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:27:56.902470 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:56.902308 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5"] Jul 27 21:27:56.905479 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:27:56.905450 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1bd56a_09d6_44a6_a007_53c4c50b3ba4.slice/crio-879ed03df44a68bcfa5e78c04f993fc0bdb1afc59b536f93d79816dc06e6a4c0 WatchSource:0}: Error finding container 879ed03df44a68bcfa5e78c04f993fc0bdb1afc59b536f93d79816dc06e6a4c0: Status 404 returned error can't find the container with id 879ed03df44a68bcfa5e78c04f993fc0bdb1afc59b536f93d79816dc06e6a4c0 Jul 27 21:27:57.896952 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:57.896911 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" event={"ID":"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4","Type":"ContainerStarted","Data":"cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e"} Jul 27 21:27:57.897459 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:27:57.896979 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" event={"ID":"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4","Type":"ContainerStarted","Data":"879ed03df44a68bcfa5e78c04f993fc0bdb1afc59b536f93d79816dc06e6a4c0"} Jul 27 21:28:00.908627 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:00.908599 2575 generic.go:356] "Generic (PLEG): container finished" podID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerID="cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e" exitCode=0 Jul 27 21:28:00.908995 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:00.908676 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" event={"ID":"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4","Type":"ContainerDied","Data":"cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e"} Jul 27 21:28:00.909867 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:00.909852 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 21:28:14.976325 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:14.976290 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" event={"ID":"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4","Type":"ContainerStarted","Data":"1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18"} Jul 27 21:28:17.991757 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:17.991713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" event={"ID":"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4","Type":"ContainerStarted","Data":"bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8"} Jul 27 21:28:17.992251 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:17.991928 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:28:17.992251 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:17.991986 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:28:17.993155 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:17.993126 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Jul 27 21:28:18.015081 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:18.015036 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podStartSLOduration=2.084210019 podStartE2EDuration="22.015022288s" totalImagesPullingTime="16.260233065s" totalInitContainerRuntime="3.670579204s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:27:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:28:18.014096746 +0000 UTC m=+1422.957117774" watchObservedRunningTime="2026-07-27 21:28:18.015022288 +0000 UTC m=+1422.958043316" Jul 27 21:28:18.996345 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:18.996306 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Jul 27 21:28:24.001680 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:24.001653 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:28:24.002131 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:24.002106 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Jul 27 21:28:34.002912 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:34.002816 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Jul 27 21:28:44.003086 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:44.003035 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Jul 27 21:28:54.002352 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:28:54.002309 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Jul 27 21:29:04.003072 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:04.003030 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Jul 27 21:29:14.003101 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:14.003054 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Jul 27 21:29:24.003093 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:24.003054 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.17:8080: connect: connection refused" Jul 27 21:29:34.002591 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:34.002561 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:29:35.565733 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:35.565700 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:29:35.568407 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:35.568385 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:29:35.569710 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:35.569688 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:29:35.572107 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:35.572087 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:29:36.609229 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:36.609190 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5"] Jul 27 21:29:36.609675 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:36.609537 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" containerID="cri-o://1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18" gracePeriod=30 Jul 27 21:29:36.609675 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:36.609638 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kube-rbac-proxy" containerID="cri-o://bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8" gracePeriod=30 Jul 27 21:29:37.292371 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:37.292336 2575 generic.go:356] "Generic (PLEG): container finished" podID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerID="bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8" exitCode=2 Jul 27 21:29:37.292371 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:37.292379 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" event={"ID":"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4","Type":"ContainerDied","Data":"bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8"} Jul 27 21:29:38.997363 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:38.997325 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.17:8643/healthz\": dial tcp 10.134.0.17:8643: connect: connection refused" Jul 27 21:29:41.557478 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.557452 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:29:41.694700 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.694671 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-rbac-proxy-sar-config\") pod \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " Jul 27 21:29:41.694880 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.694731 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thg2b\" (UniqueName: \"kubernetes.io/projected/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-api-access-thg2b\") pod \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " Jul 27 21:29:41.694880 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.694752 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kserve-provision-location\") pod \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " Jul 27 21:29:41.694880 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.694793 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-proxy-tls\") pod \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " Jul 27 21:29:41.694880 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.694817 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-cabundle-cert\") pod \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\" (UID: \"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4\") " Jul 27 21:29:41.695098 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.695050 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" (UID: "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:29:41.695151 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.695113 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" (UID: "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:29:41.695225 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.695204 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" (UID: "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:29:41.697287 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.697257 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-api-access-thg2b" (OuterVolumeSpecName: "kube-api-access-thg2b") pod "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" (UID: "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4"). InnerVolumeSpecName "kube-api-access-thg2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:29:41.697450 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.697266 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" (UID: "5f1bd56a-09d6-44a6-a007-53c4c50b3ba4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:29:41.796076 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.796038 2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-proxy-tls\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:29:41.796076 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.796067 2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-cabundle-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:29:41.796076 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.796080 2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:29:41.796308 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.796089 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thg2b\" (UniqueName: \"kubernetes.io/projected/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kube-api-access-thg2b\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:29:41.796308 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:41.796098 2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4-kserve-provision-location\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:29:42.314236 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.314199 2575 generic.go:356] "Generic (PLEG): container finished" podID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerID="1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18" exitCode=0 Jul 27 21:29:42.314454 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.314244 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" event={"ID":"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4","Type":"ContainerDied","Data":"1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18"} Jul 27 21:29:42.314454 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.314283 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" Jul 27 21:29:42.314454 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.314294 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5" event={"ID":"5f1bd56a-09d6-44a6-a007-53c4c50b3ba4","Type":"ContainerDied","Data":"879ed03df44a68bcfa5e78c04f993fc0bdb1afc59b536f93d79816dc06e6a4c0"} Jul 27 21:29:42.314454 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.314320 2575 scope.go:117] "RemoveContainer" containerID="bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8" Jul 27 21:29:42.322917 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.322899 2575 scope.go:117] "RemoveContainer" containerID="1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18" Jul 27 21:29:42.330295 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.330273 2575 scope.go:117] "RemoveContainer" containerID="cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e" Jul 27 21:29:42.335798 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.335774 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5"] Jul 27 21:29:42.338235 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.338213 2575 scope.go:117] "RemoveContainer" containerID="bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8" Jul 27 21:29:42.338598 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:29:42.338574 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8\": container with ID starting with bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8 not found: ID does not exist" containerID="bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8" Jul 27 21:29:42.338672 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.338606 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8"} err="failed to get container status \"bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8\": rpc error: code = NotFound desc = could not find container \"bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8\": container with ID starting with bf057f04341c39408a777675b0e7cedccca1e8137d6bd0f6b5ef2e4bbba1daa8 not found: ID does not exist" Jul 27 21:29:42.338672 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.338645 2575 scope.go:117] "RemoveContainer" containerID="1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18" Jul 27 21:29:42.338921 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:29:42.338902 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18\": container with ID starting with 1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18 not found: ID does not exist" containerID="1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18" Jul 27 21:29:42.338959 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.338929 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18"} err="failed to get container status \"1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18\": rpc error: code = NotFound desc = could not find container \"1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18\": container with ID starting with 1d9a86b98364ed32b7361758a95ebe96455c88017b885dfff5a59f01fc76fb18 not found: ID does not exist" Jul 27 21:29:42.338959 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.338946 2575 scope.go:117] "RemoveContainer" containerID="cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e" Jul 27 21:29:42.339199 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:29:42.339184 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e\": container with ID starting with cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e not found: ID does not exist" containerID="cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e" Jul 27 21:29:42.339293 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.339203 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e"} err="failed to get container status \"cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e\": rpc error: code = NotFound desc = could not find container \"cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e\": container with ID starting with cd3bf9d1bbc8a31297f497361ce9a99acad38e23e40d5d1c899e29ef483f707e not found: ID does not exist" Jul 27 21:29:42.339416 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:42.339400 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-promote-v2-predictor-86766c4958-pkjv5"] Jul 27 21:29:43.669728 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:29:43.669693 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" path="/var/lib/kubelet/pods/5f1bd56a-09d6-44a6-a007-53c4c50b3ba4/volumes" Jul 27 21:31:11.916685 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.916649 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2"] Jul 27 21:31:11.917162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.916943 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="storage-initializer" Jul 27 21:31:11.917162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.916955 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="storage-initializer" Jul 27 21:31:11.917162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.916963 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" Jul 27 21:31:11.917162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.916968 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" Jul 27 21:31:11.917162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.916985 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kube-rbac-proxy" Jul 27 21:31:11.917162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.916991 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kube-rbac-proxy" Jul 27 21:31:11.917162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.917044 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kube-rbac-proxy" Jul 27 21:31:11.917162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.917054 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1bd56a-09d6-44a6-a007-53c4c50b3ba4" containerName="kserve-container" Jul 27 21:31:11.919812 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.919797 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:11.920409 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.920385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8201187d-c0af-44c8-b1da-1aedd62dd894-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:11.920536 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.920442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8xln\" (UniqueName: \"kubernetes.io/projected/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-api-access-w8xln\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:11.920536 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.920496 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8201187d-c0af-44c8-b1da-1aedd62dd894-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:11.920603 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.920560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:11.920640 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.920601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:11.922462 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.922441 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\"" Jul 27 21:31:11.922626 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.922606 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 27 21:31:11.922697 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.922673 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-cmm8z\"" Jul 27 21:31:11.923719 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.923700 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 27 21:31:11.923805 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.923720 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 27 21:31:11.923805 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.923758 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\"" Jul 27 21:31:11.923805 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.923765 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 27 21:31:11.935120 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:11.935097 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2"] Jul 27 21:31:12.020850 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.020813 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8201187d-c0af-44c8-b1da-1aedd62dd894-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.021049 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.020864 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.021049 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.020899 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.021167 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.021045 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8201187d-c0af-44c8-b1da-1aedd62dd894-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.021167 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.021106 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8xln\" (UniqueName: \"kubernetes.io/projected/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-api-access-w8xln\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.021466 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.021418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8201187d-c0af-44c8-b1da-1aedd62dd894-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.021624 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.021605 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-cabundle-cert\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.021678 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.021636 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.023505 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.023477 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8201187d-c0af-44c8-b1da-1aedd62dd894-proxy-tls\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.029365 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.029345 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8xln\" (UniqueName: \"kubernetes.io/projected/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-api-access-w8xln\") pod \"isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.230644 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.230564 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:12.362312 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.362288 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2"] Jul 27 21:31:12.364788 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:31:12.364762 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8201187d_c0af_44c8_b1da_1aedd62dd894.slice/crio-a9d457eb45ec4e1779afabdf08a714426957de61a06727e8c9996a39cf4db800 WatchSource:0}: Error finding container a9d457eb45ec4e1779afabdf08a714426957de61a06727e8c9996a39cf4db800: Status 404 returned error can't find the container with id a9d457eb45ec4e1779afabdf08a714426957de61a06727e8c9996a39cf4db800 Jul 27 21:31:12.643274 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.643185 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" event={"ID":"8201187d-c0af-44c8-b1da-1aedd62dd894","Type":"ContainerStarted","Data":"519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14"} Jul 27 21:31:12.643274 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:12.643252 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" event={"ID":"8201187d-c0af-44c8-b1da-1aedd62dd894","Type":"ContainerStarted","Data":"a9d457eb45ec4e1779afabdf08a714426957de61a06727e8c9996a39cf4db800"} Jul 27 21:31:16.659390 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:16.659352 2575 generic.go:356] "Generic (PLEG): container finished" podID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerID="519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14" exitCode=0 Jul 27 21:31:16.659781 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:16.659448 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" event={"ID":"8201187d-c0af-44c8-b1da-1aedd62dd894","Type":"ContainerDied","Data":"519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14"} Jul 27 21:31:17.669193 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:17.669155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" event={"ID":"8201187d-c0af-44c8-b1da-1aedd62dd894","Type":"ContainerStarted","Data":"3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a"} Jul 27 21:31:17.669676 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:17.669215 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" event={"ID":"8201187d-c0af-44c8-b1da-1aedd62dd894","Type":"ContainerStarted","Data":"a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae"} Jul 27 21:31:17.688681 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:17.688626 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podStartSLOduration=2.967372642 podStartE2EDuration="6.688610065s" totalImagesPullingTime="0s" totalInitContainerRuntime="3.721237423s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:31:17.688212263 +0000 UTC m=+1602.631233292" watchObservedRunningTime="2026-07-27 21:31:17.688610065 +0000 UTC m=+1602.631631165" Jul 27 21:31:22.669803 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:22.669763 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:22.670266 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:22.670227 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:22.671190 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:22.671162 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Jul 27 21:31:22.675588 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:22.675566 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:31:22.683026 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:22.682990 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Jul 27 21:31:23.686298 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:23.686262 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Jul 27 21:31:33.687267 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:33.687172 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Jul 27 21:31:43.686818 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:43.686771 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Jul 27 21:31:53.686488 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:31:53.686398 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Jul 27 21:32:03.687200 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:03.687158 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Jul 27 21:32:13.686481 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:13.686409 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Jul 27 21:32:23.687174 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:23.687132 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.18:8080: connect: connection refused" Jul 27 21:32:30.666151 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:30.666122 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:32:31.951579 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:31.951544 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2"] Jul 27 21:32:31.952006 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:31.951750 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" containerID="cri-o://a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae" gracePeriod=30 Jul 27 21:32:31.952006 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:31.951794 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kube-rbac-proxy" containerID="cri-o://3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a" gracePeriod=30 Jul 27 21:32:32.676931 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:32.676878 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.18:8643/healthz\": dial tcp 10.134.0.18:8643: connect: connection refused" Jul 27 21:32:32.945684 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:32.945599 2575 generic.go:356] "Generic (PLEG): container finished" podID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerID="3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a" exitCode=2 Jul 27 21:32:32.945684 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:32.945674 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" event={"ID":"8201187d-c0af-44c8-b1da-1aedd62dd894","Type":"ContainerDied","Data":"3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a"} Jul 27 21:32:36.906208 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.906177 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:32:36.961335 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.961299 2575 generic.go:356] "Generic (PLEG): container finished" podID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerID="a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae" exitCode=0 Jul 27 21:32:36.961515 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.961345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" event={"ID":"8201187d-c0af-44c8-b1da-1aedd62dd894","Type":"ContainerDied","Data":"a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae"} Jul 27 21:32:36.961515 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.961351 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" Jul 27 21:32:36.961515 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.961392 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2" event={"ID":"8201187d-c0af-44c8-b1da-1aedd62dd894","Type":"ContainerDied","Data":"a9d457eb45ec4e1779afabdf08a714426957de61a06727e8c9996a39cf4db800"} Jul 27 21:32:36.961515 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.961418 2575 scope.go:117] "RemoveContainer" containerID="3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a" Jul 27 21:32:36.969288 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.969270 2575 scope.go:117] "RemoveContainer" containerID="a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae" Jul 27 21:32:36.978276 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.978254 2575 scope.go:117] "RemoveContainer" containerID="519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14" Jul 27 21:32:36.980593 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.980560 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-cabundle-cert\") pod \"8201187d-c0af-44c8-b1da-1aedd62dd894\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " Jul 27 21:32:36.980701 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.980620 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-rbac-proxy-sar-config\") pod \"8201187d-c0af-44c8-b1da-1aedd62dd894\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " Jul 27 21:32:36.980701 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.980663 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8201187d-c0af-44c8-b1da-1aedd62dd894-kserve-provision-location\") pod \"8201187d-c0af-44c8-b1da-1aedd62dd894\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " Jul 27 21:32:36.980701 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.980697 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8xln\" (UniqueName: \"kubernetes.io/projected/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-api-access-w8xln\") pod \"8201187d-c0af-44c8-b1da-1aedd62dd894\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " Jul 27 21:32:36.980923 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.980774 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8201187d-c0af-44c8-b1da-1aedd62dd894-proxy-tls\") pod \"8201187d-c0af-44c8-b1da-1aedd62dd894\" (UID: \"8201187d-c0af-44c8-b1da-1aedd62dd894\") " Jul 27 21:32:36.980993 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.980963 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "8201187d-c0af-44c8-b1da-1aedd62dd894" (UID: "8201187d-c0af-44c8-b1da-1aedd62dd894"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:32:36.981048 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.980993 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8201187d-c0af-44c8-b1da-1aedd62dd894-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8201187d-c0af-44c8-b1da-1aedd62dd894" (UID: "8201187d-c0af-44c8-b1da-1aedd62dd894"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 21:32:36.981048 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.981015 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "8201187d-c0af-44c8-b1da-1aedd62dd894" (UID: "8201187d-c0af-44c8-b1da-1aedd62dd894"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 21:32:36.982881 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.982852 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8201187d-c0af-44c8-b1da-1aedd62dd894-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8201187d-c0af-44c8-b1da-1aedd62dd894" (UID: "8201187d-c0af-44c8-b1da-1aedd62dd894"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 21:32:36.982881 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.982857 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-api-access-w8xln" (OuterVolumeSpecName: "kube-api-access-w8xln") pod "8201187d-c0af-44c8-b1da-1aedd62dd894" (UID: "8201187d-c0af-44c8-b1da-1aedd62dd894"). InnerVolumeSpecName "kube-api-access-w8xln". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 21:32:36.986179 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.986161 2575 scope.go:117] "RemoveContainer" containerID="3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a" Jul 27 21:32:36.986463 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:32:36.986444 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a\": container with ID starting with 3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a not found: ID does not exist" containerID="3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a" Jul 27 21:32:36.986529 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.986469 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a"} err="failed to get container status \"3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a\": rpc error: code = NotFound desc = could not find container \"3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a\": container with ID starting with 3da72cda6428ff0786aa5251f7bc9047251943ad66f871939032df405abdad8a not found: ID does not exist" Jul 27 21:32:36.986529 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.986489 2575 scope.go:117] "RemoveContainer" containerID="a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae" Jul 27 21:32:36.986771 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:32:36.986754 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae\": container with ID starting with a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae not found: ID does not exist" containerID="a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae" Jul 27 21:32:36.986815 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.986777 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae"} err="failed to get container status \"a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae\": rpc error: code = NotFound desc = could not find container \"a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae\": container with ID starting with a92ec55d434ef9e7711765b99ac0c8ed1dc1906da9741c4d81c553904fd889ae not found: ID does not exist" Jul 27 21:32:36.986815 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.986793 2575 scope.go:117] "RemoveContainer" containerID="519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14" Jul 27 21:32:36.987035 ip-10-0-139-153 kubenswrapper[2575]: E0727 21:32:36.987017 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14\": container with ID starting with 519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14 not found: ID does not exist" containerID="519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14" Jul 27 21:32:36.987096 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:36.987042 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14"} err="failed to get container status \"519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14\": rpc error: code = NotFound desc = could not find container \"519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14\": container with ID starting with 519568752f07c9f184cb50883a98e52eabefc7c168bd45964ce22d7157b0cd14 not found: ID does not exist" Jul 27 21:32:37.082066 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:37.081976 2575 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-cabundle-cert\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:32:37.082066 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:37.082001 2575 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:32:37.082066 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:37.082011 2575 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8201187d-c0af-44c8-b1da-1aedd62dd894-kserve-provision-location\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:32:37.082066 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:37.082020 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8xln\" (UniqueName: \"kubernetes.io/projected/8201187d-c0af-44c8-b1da-1aedd62dd894-kube-api-access-w8xln\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:32:37.082066 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:37.082029 2575 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8201187d-c0af-44c8-b1da-1aedd62dd894-proxy-tls\") on node \"ip-10-0-139-153.ec2.internal\" DevicePath \"\"" Jul 27 21:32:37.283128 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:37.283098 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2"] Jul 27 21:32:37.286827 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:37.286803 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-5bbb8c8cfc-dr7c2"] Jul 27 21:32:37.669297 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:32:37.669265 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" path="/var/lib/kubelet/pods/8201187d-c0af-44c8-b1da-1aedd62dd894/volumes" Jul 27 21:34:35.589159 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:34:35.589127 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:34:35.591367 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:34:35.591345 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:34:35.592767 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:34:35.592746 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:34:35.594838 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:34:35.594816 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:39:35.612110 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:39:35.612078 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:39:35.615149 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:39:35.615126 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:39:35.615954 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:39:35.615932 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:39:35.618581 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:39:35.618563 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:40:22.558976 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.558933 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cbjts/must-gather-9n2xv"] Jul 27 21:40:22.559621 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.559306 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="storage-initializer" Jul 27 21:40:22.559621 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.559323 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="storage-initializer" Jul 27 21:40:22.559621 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.559345 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kube-rbac-proxy" Jul 27 21:40:22.559621 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.559352 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kube-rbac-proxy" Jul 27 21:40:22.559621 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.559378 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" Jul 27 21:40:22.559621 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.559387 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" Jul 27 21:40:22.559621 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.559480 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kserve-container" Jul 27 21:40:22.559621 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.559493 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8201187d-c0af-44c8-b1da-1aedd62dd894" containerName="kube-rbac-proxy" Jul 27 21:40:22.562689 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.562661 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cbjts/must-gather-9n2xv" Jul 27 21:40:22.565305 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.565284 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cbjts\"/\"openshift-service-ca.crt\"" Jul 27 21:40:22.566480 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.566464 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cbjts\"/\"kube-root-ca.crt\"" Jul 27 21:40:22.566542 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.566464 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cbjts\"/\"default-dockercfg-5jhdr\"" Jul 27 21:40:22.569565 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.569474 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cbjts/must-gather-9n2xv"] Jul 27 21:40:22.674623 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.674592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2lvh\" (UniqueName: \"kubernetes.io/projected/b6a7ae98-01e9-4582-b0b1-1e89690ab2d6-kube-api-access-x2lvh\") pod \"must-gather-9n2xv\" (UID: \"b6a7ae98-01e9-4582-b0b1-1e89690ab2d6\") " pod="openshift-must-gather-cbjts/must-gather-9n2xv" Jul 27 21:40:22.674800 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.674641 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6a7ae98-01e9-4582-b0b1-1e89690ab2d6-must-gather-output\") pod \"must-gather-9n2xv\" (UID: \"b6a7ae98-01e9-4582-b0b1-1e89690ab2d6\") " pod="openshift-must-gather-cbjts/must-gather-9n2xv" Jul 27 21:40:22.774981 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.774946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2lvh\" (UniqueName: \"kubernetes.io/projected/b6a7ae98-01e9-4582-b0b1-1e89690ab2d6-kube-api-access-x2lvh\") pod \"must-gather-9n2xv\" (UID: \"b6a7ae98-01e9-4582-b0b1-1e89690ab2d6\") " pod="openshift-must-gather-cbjts/must-gather-9n2xv" Jul 27 21:40:22.775176 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.774988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6a7ae98-01e9-4582-b0b1-1e89690ab2d6-must-gather-output\") pod \"must-gather-9n2xv\" (UID: \"b6a7ae98-01e9-4582-b0b1-1e89690ab2d6\") " pod="openshift-must-gather-cbjts/must-gather-9n2xv" Jul 27 21:40:22.775408 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.775375 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6a7ae98-01e9-4582-b0b1-1e89690ab2d6-must-gather-output\") pod \"must-gather-9n2xv\" (UID: \"b6a7ae98-01e9-4582-b0b1-1e89690ab2d6\") " pod="openshift-must-gather-cbjts/must-gather-9n2xv" Jul 27 21:40:22.784137 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.784113 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2lvh\" (UniqueName: \"kubernetes.io/projected/b6a7ae98-01e9-4582-b0b1-1e89690ab2d6-kube-api-access-x2lvh\") pod \"must-gather-9n2xv\" (UID: \"b6a7ae98-01e9-4582-b0b1-1e89690ab2d6\") " pod="openshift-must-gather-cbjts/must-gather-9n2xv" Jul 27 21:40:22.873048 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.872969 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cbjts/must-gather-9n2xv" Jul 27 21:40:22.999597 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:22.999562 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cbjts/must-gather-9n2xv"] Jul 27 21:40:23.003584 ip-10-0-139-153 kubenswrapper[2575]: W0727 21:40:23.003553 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6a7ae98_01e9_4582_b0b1_1e89690ab2d6.slice/crio-5679376ba728b92b227c1c24d128f066ebec8a64919d9bbc757dcfeadf74fa92 WatchSource:0}: Error finding container 5679376ba728b92b227c1c24d128f066ebec8a64919d9bbc757dcfeadf74fa92: Status 404 returned error can't find the container with id 5679376ba728b92b227c1c24d128f066ebec8a64919d9bbc757dcfeadf74fa92 Jul 27 21:40:23.005523 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:23.005501 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 21:40:23.683500 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:23.683466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cbjts/must-gather-9n2xv" event={"ID":"b6a7ae98-01e9-4582-b0b1-1e89690ab2d6","Type":"ContainerStarted","Data":"5679376ba728b92b227c1c24d128f066ebec8a64919d9bbc757dcfeadf74fa92"} Jul 27 21:40:24.690383 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:24.690349 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cbjts/must-gather-9n2xv" event={"ID":"b6a7ae98-01e9-4582-b0b1-1e89690ab2d6","Type":"ContainerStarted","Data":"713f755ea68506b8f75d493f2ab575db0ce07b7397901da3d6798d0e58fc18ba"} Jul 27 21:40:24.690839 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:24.690393 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cbjts/must-gather-9n2xv" event={"ID":"b6a7ae98-01e9-4582-b0b1-1e89690ab2d6","Type":"ContainerStarted","Data":"e66f86c3f7e50959f1925caaa0971379bca6cc5d8fd7ef80e0816e74b5d0be3b"} Jul 27 21:40:25.117482 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:25.117378 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7sbtn_a22b8bbf-dcd5-4856-ba68-ee02abe770b7/global-pull-secret-syncer/0.log" Jul 27 21:40:25.320524 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:25.320369 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sw9mr_3f1eb411-3b84-4744-9381-c1dfad2b10b5/konnectivity-agent/0.log" Jul 27 21:40:25.389262 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:25.389135 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-153.ec2.internal_be484760452c4488384d3c6b0a59fc4e/haproxy/0.log" Jul 27 21:40:29.368824 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.368798 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2k2pt_fcfa4367-9047-4e4c-b3f3-34c1c937e0c6/node-exporter/0.log" Jul 27 21:40:29.400877 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.400856 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2k2pt_fcfa4367-9047-4e4c-b3f3-34c1c937e0c6/kube-rbac-proxy/0.log" Jul 27 21:40:29.432609 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.432576 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2k2pt_fcfa4367-9047-4e4c-b3f3-34c1c937e0c6/init-textfile/0.log" Jul 27 21:40:29.654442 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.654399 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74338f19-47e1-4414-a5b5-0cc6ec5790ac/prometheus/0.log" Jul 27 21:40:29.678271 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.678243 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74338f19-47e1-4414-a5b5-0cc6ec5790ac/config-reloader/0.log" Jul 27 21:40:29.701783 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.701751 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74338f19-47e1-4414-a5b5-0cc6ec5790ac/thanos-sidecar/0.log" Jul 27 21:40:29.726863 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.726811 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74338f19-47e1-4414-a5b5-0cc6ec5790ac/kube-rbac-proxy-web/0.log" Jul 27 21:40:29.757546 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.757519 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74338f19-47e1-4414-a5b5-0cc6ec5790ac/kube-rbac-proxy/0.log" Jul 27 21:40:29.780160 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.780115 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74338f19-47e1-4414-a5b5-0cc6ec5790ac/kube-rbac-proxy-thanos/0.log" Jul 27 21:40:29.804812 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:29.804784 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_74338f19-47e1-4414-a5b5-0cc6ec5790ac/init-config-reloader/0.log" Jul 27 21:40:31.535664 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:31.535637 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-cj8mw_e7cae463-d4e7-489a-8db9-a51e2976c563/networking-console-plugin/0.log" Jul 27 21:40:32.117352 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:32.117322 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/1.log" Jul 27 21:40:32.124774 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:32.124721 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-9lh9h_f4357648-98b8-4ce0-8ddc-029955ffeabb/console-operator/2.log" Jul 27 21:40:33.450316 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.450248 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cbjts/must-gather-9n2xv" podStartSLOduration=10.685750062 podStartE2EDuration="11.450229486s" totalImagesPullingTime="764.479424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 21:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:24.705890923 +0000 UTC m=+2149.648911952" watchObservedRunningTime="2026-07-27 21:40:33.450229486 +0000 UTC m=+2158.393250515" Jul 27 21:40:33.450913 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.450769 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746"] Jul 27 21:40:33.456831 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.456795 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.465815 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.465777 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746"] Jul 27 21:40:33.572780 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.572738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-lib-modules\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.572780 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.572785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-proc\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.572991 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.572814 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-sys\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.572991 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.572955 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-podres\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.573074 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.573006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtrg\" (UniqueName: \"kubernetes.io/projected/22a972d1-35b3-40b3-a23f-0fcebd66161a-kube-api-access-nbtrg\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.673893 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.673856 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-lib-modules\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.674342 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.674319 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-proc\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.674550 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.674524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-sys\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.674550 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.674538 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-proc\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.674550 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.674250 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-lib-modules\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.674742 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.674591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-podres\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.674742 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.674615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtrg\" (UniqueName: \"kubernetes.io/projected/22a972d1-35b3-40b3-a23f-0fcebd66161a-kube-api-access-nbtrg\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.674742 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.674629 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-sys\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.674742 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.674703 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22a972d1-35b3-40b3-a23f-0fcebd66161a-podres\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.683705 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.683677 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtrg\" (UniqueName: \"kubernetes.io/projected/22a972d1-35b3-40b3-a23f-0fcebd66161a-kube-api-access-nbtrg\") pod \"perf-node-gather-daemonset-dj746\" (UID: \"22a972d1-35b3-40b3-a23f-0fcebd66161a\") " pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.770390 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.770275 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:33.931641 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:33.931007 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746"] Jul 27 21:40:34.131852 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:34.131825 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cpc2t_5b8f52aa-bdb5-4a39-9233-df881ec8d638/dns/0.log" Jul 27 21:40:34.154278 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:34.154252 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cpc2t_5b8f52aa-bdb5-4a39-9233-df881ec8d638/kube-rbac-proxy/0.log" Jul 27 21:40:34.245284 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:34.245253 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-52fqc_f6a58687-1aed-4540-ba0e-c4f32ada0330/dns-node-resolver/0.log" Jul 27 21:40:34.743296 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:34.743251 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" event={"ID":"22a972d1-35b3-40b3-a23f-0fcebd66161a","Type":"ContainerStarted","Data":"7706d3eac9daee15be262c78e3e670011ad4f564f9211916819bd992643af178"} Jul 27 21:40:34.743818 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:34.743324 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" event={"ID":"22a972d1-35b3-40b3-a23f-0fcebd66161a","Type":"ContainerStarted","Data":"6400b3c59bde449401fee882ee543d77e9ca377a25f9c5bb257da9e578dc60cb"} Jul 27 21:40:34.743818 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:34.743404 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:34.764850 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:34.759926 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" podStartSLOduration=1.759897394 podStartE2EDuration="1.759897394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 21:40:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 21:40:34.758216771 +0000 UTC m=+2159.701237799" watchObservedRunningTime="2026-07-27 21:40:34.759897394 +0000 UTC m=+2159.702918426" Jul 27 21:40:34.808671 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:34.808612 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-thftq_23060fe1-e58e-47b8-b213-1e259ef3b79c/node-ca/0.log" Jul 27 21:40:35.961051 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:35.961017 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rw4mc_33ed798f-d12c-4ca1-8ed5-c96de1ba18de/serve-healthcheck-canary/0.log" Jul 27 21:40:36.396456 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:36.396368 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c66x5_f5caac3c-73de-4b2e-a8d9-fae91c6522b2/kube-rbac-proxy/0.log" Jul 27 21:40:36.417253 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:36.417227 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c66x5_f5caac3c-73de-4b2e-a8d9-fae91c6522b2/exporter/0.log" Jul 27 21:40:36.439327 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:36.439299 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c66x5_f5caac3c-73de-4b2e-a8d9-fae91c6522b2/extractor/0.log" Jul 27 21:40:38.951273 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:38.951244 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-2dzhf_51d56a9d-f1da-4dda-aab9-7b20c0cc1633/s3-init/0.log" Jul 27 21:40:38.966783 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:38.966759 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-2dzhf_51d56a9d-f1da-4dda-aab9-7b20c0cc1633/download-hf-model/0.log" Jul 27 21:40:40.760464 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:40.760413 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cbjts/perf-node-gather-daemonset-dj746" Jul 27 21:40:42.856101 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:42.856068 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-zqg5w_eca792b6-734b-4293-b98b-909faf986dfc/migrator/0.log" Jul 27 21:40:42.878844 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:42.878817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-zqg5w_eca792b6-734b-4293-b98b-909faf986dfc/graceful-termination/0.log" Jul 27 21:40:43.238198 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:43.238160 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc_d65d11be-b256-44ef-a27a-cb191debeb86/kube-storage-version-migrator-operator/1.log" Jul 27 21:40:43.239282 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:43.239257 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-vhvbc_d65d11be-b256-44ef-a27a-cb191debeb86/kube-storage-version-migrator-operator/0.log" Jul 27 21:40:44.348294 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.348262 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwrdj_3c240878-122d-4ffe-85bb-00f3ffcf15c9/kube-multus-additional-cni-plugins/0.log" Jul 27 21:40:44.379088 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.379063 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwrdj_3c240878-122d-4ffe-85bb-00f3ffcf15c9/egress-router-binary-copy/0.log" Jul 27 21:40:44.404162 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.404141 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwrdj_3c240878-122d-4ffe-85bb-00f3ffcf15c9/cni-plugins/0.log" Jul 27 21:40:44.429951 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.429925 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwrdj_3c240878-122d-4ffe-85bb-00f3ffcf15c9/bond-cni-plugin/0.log" Jul 27 21:40:44.460639 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.460609 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwrdj_3c240878-122d-4ffe-85bb-00f3ffcf15c9/routeoverride-cni/0.log" Jul 27 21:40:44.485775 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.485749 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwrdj_3c240878-122d-4ffe-85bb-00f3ffcf15c9/whereabouts-cni-bincopy/0.log" Jul 27 21:40:44.508562 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.508535 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwrdj_3c240878-122d-4ffe-85bb-00f3ffcf15c9/whereabouts-cni/0.log" Jul 27 21:40:44.743717 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.743648 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w86wc_06d51315-6389-42de-8ac4-28d350e61677/kube-multus/0.log" Jul 27 21:40:44.813807 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.813752 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fk22f_56e54f19-f7c4-4828-9333-7f61dacd4781/network-metrics-daemon/0.log" Jul 27 21:40:44.834506 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:44.834478 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fk22f_56e54f19-f7c4-4828-9333-7f61dacd4781/kube-rbac-proxy/0.log" Jul 27 21:40:45.599350 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:45.599318 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-controller/0.log" Jul 27 21:40:45.618390 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:45.618363 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/0.log" Jul 27 21:40:45.618554 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:45.618414 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovn-acl-logging/1.log" Jul 27 21:40:45.636080 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:45.636053 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/kube-rbac-proxy-node/0.log" Jul 27 21:40:45.658119 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:45.658096 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 21:40:45.679634 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:45.679609 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/northd/0.log" Jul 27 21:40:45.700526 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:45.700503 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/nbdb/0.log" Jul 27 21:40:45.720904 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:45.720879 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/sbdb/0.log" Jul 27 21:40:45.762760 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:45.762673 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnlqv_72422086-5752-4ba5-8c13-0521ac39e0f3/ovnkube-controller/0.log" Jul 27 21:40:47.279549 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:47.279520 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-26hcs_29b4c36b-f1cc-4e94-8f69-ba1141da6f41/network-check-target-container/0.log" Jul 27 21:40:48.236223 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:48.236191 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-65gz9_e5a52839-770b-4575-9afa-fdc879260cbd/iptables-alerter/0.log" Jul 27 21:40:48.882536 ip-10-0-139-153 kubenswrapper[2575]: I0727 21:40:48.882508 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9lvcm_157f3110-39dc-44b2-8148-5171965fbc8a/tuned/0.log"