Aug 04 18:00:03.594799 ip-10-0-128-51 systemd[1]: Starting Kubernetes Kubelet... Aug 04 18:00:03.935923 ip-10-0-128-51 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 18:00:03.935923 ip-10-0-128-51 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 04 18:00:03.935923 ip-10-0-128-51 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 18:00:03.935923 ip-10-0-128-51 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 04 18:00:03.935923 ip-10-0-128-51 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 04 18:00:03.938179 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.938055 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 04 18:00:03.942839 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942823 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 18:00:03.942839 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942839 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942843 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942847 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942850 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942852 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942855 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942858 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942861 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942866 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942870 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942874 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942878 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942881 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942885 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942888 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942891 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942894 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942897 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942900 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 18:00:03.942900 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942903 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942906 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942909 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942912 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942915 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942918 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942921 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942924 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942927 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942929 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942932 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942935 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942938 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942940 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942943 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942946 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942948 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942951 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942953 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942956 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 18:00:03.943485 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942959 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942961 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942964 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942966 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942969 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942972 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942974 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942978 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942980 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942983 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942985 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942988 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942990 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942993 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942996 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.942999 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943001 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943004 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943006 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 18:00:03.944223 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943009 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943011 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943015 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943017 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943021 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943025 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943028 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943031 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943034 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943037 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943040 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943042 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943045 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943047 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943050 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943053 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943055 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943058 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943060 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 18:00:03.944765 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943063 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943065 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943110 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943143 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943149 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943152 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943155 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943158 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943163 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943166 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943258 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943266 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943274 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943282 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943289 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943302 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943310 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943318 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943325 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943333 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 18:00:03.945207 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.943340 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945250 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945262 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945266 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945269 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945273 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945275 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945278 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945280 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945283 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945285 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945288 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945291 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945293 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945296 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945302 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945306 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945310 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945313 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 18:00:03.945679 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945317 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945320 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945323 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945326 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945329 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945331 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945333 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945336 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945339 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945341 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945344 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945346 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945349 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945352 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945354 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945357 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945361 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945364 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945366 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945369 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 18:00:03.946137 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945371 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945374 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945377 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945380 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945382 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945385 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945390 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945393 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945396 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945399 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945402 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945404 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945407 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945410 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945413 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945415 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945418 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945421 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945423 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945426 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 18:00:03.946629 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945428 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945431 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945434 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945436 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945439 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945441 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945444 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945449 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945451 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945454 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945457 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945459 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945462 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945465 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945467 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945470 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945472 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945474 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945478 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945481 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 18:00:03.947106 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945483 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945485 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945488 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945490 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945493 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945495 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945498 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945514 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945517 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945520 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945522 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945525 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945527 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945530 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945533 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945536 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945539 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945541 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945544 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 18:00:03.947589 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945549 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945552 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945933 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945938 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945941 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945944 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945947 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945949 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945952 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945955 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945957 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945960 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945963 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945965 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945968 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945970 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945973 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945976 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945979 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 18:00:03.948048 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945981 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945983 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945986 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945990 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945994 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.945997 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946000 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946002 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946005 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946008 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946010 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946013 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946016 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946020 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946023 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946026 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946028 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946031 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946033 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 18:00:03.948511 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946036 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946038 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946041 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946043 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946046 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946048 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946050 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946053 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946055 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946058 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946060 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946063 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946065 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946068 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946070 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946073 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946075 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946077 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946080 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946082 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 18:00:03.948956 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946085 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946087 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946090 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946092 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946110 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946114 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946118 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946122 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946125 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946127 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946130 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946133 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946136 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946138 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946141 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946144 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946147 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946149 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946153 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946155 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 18:00:03.949463 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946158 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946160 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946163 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946166 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946169 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946173 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946176 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946178 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946181 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946185 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946188 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946191 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946193 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946196 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946199 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946201 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946204 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946207 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946210 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 18:00:03.950054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946213 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946216 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946219 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946222 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946290 2583 flags.go:64] FLAG: --address="0.0.0.0" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946297 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946303 2583 flags.go:64] FLAG: --anonymous-auth="true" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946307 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946312 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946315 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946319 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946324 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946327 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946330 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946333 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946336 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946340 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946343 2583 flags.go:64] FLAG: --cgroup-root="" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946346 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946349 2583 flags.go:64] FLAG: --client-ca-file="" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946352 2583 flags.go:64] FLAG: --cloud-provider="external" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946354 2583 flags.go:64] FLAG: --cluster-dns="[]" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946359 2583 flags.go:64] FLAG: --cluster-domain="" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946362 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 04 18:00:03.950510 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946365 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946368 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946371 2583 flags.go:64] FLAG: --container-log-max-files="5" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946375 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946378 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946381 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946385 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946389 2583 flags.go:64] FLAG: --contention-profiling="false" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946392 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946394 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946398 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946402 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946406 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946409 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946412 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946415 2583 flags.go:64] FLAG: --enable-load-reader="false" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946417 2583 flags.go:64] FLAG: --enable-server="true" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946420 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946425 2583 flags.go:64] FLAG: --event-burst="100" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946428 2583 flags.go:64] FLAG: --event-qps="50" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946430 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946434 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946436 2583 flags.go:64] FLAG: --eviction-hard="" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946440 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 04 18:00:03.951082 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946444 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946448 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946453 2583 flags.go:64] FLAG: --eviction-soft="" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946458 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946462 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946466 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946471 2583 flags.go:64] FLAG: --experimental-mounter-path="" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946476 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946481 2583 flags.go:64] FLAG: --fail-swap-on="true" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946484 2583 flags.go:64] FLAG: --feature-gates="" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946488 2583 flags.go:64] FLAG: --file-check-frequency="20s" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946491 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946494 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946497 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946514 2583 flags.go:64] FLAG: --healthz-port="10248" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946517 2583 flags.go:64] FLAG: --help="false" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946520 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-128-51.ec2.internal" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946524 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946527 2583 flags.go:64] FLAG: --http-check-frequency="20s" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946531 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946534 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946538 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946540 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 04 18:00:03.951671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946543 2583 flags.go:64] FLAG: --image-service-endpoint="" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946546 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946549 2583 flags.go:64] FLAG: --kube-api-burst="100" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946551 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946554 2583 flags.go:64] FLAG: --kube-api-qps="50" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946557 2583 flags.go:64] FLAG: --kube-reserved="" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946560 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946563 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946566 2583 flags.go:64] FLAG: --kubelet-cgroups="" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946569 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946571 2583 flags.go:64] FLAG: --lock-file="" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946574 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946577 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946580 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946585 2583 flags.go:64] FLAG: --log-json-split-stream="false" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946588 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946596 2583 flags.go:64] FLAG: --log-text-split-stream="false" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946599 2583 flags.go:64] FLAG: --logging-format="text" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946602 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946606 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946609 2583 flags.go:64] FLAG: --manifest-url="" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946612 2583 flags.go:64] FLAG: --manifest-url-header="" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946616 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946619 2583 flags.go:64] FLAG: --max-open-files="1000000" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946628 2583 flags.go:64] FLAG: --max-pods="110" Aug 04 18:00:03.952230 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946631 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946634 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946637 2583 flags.go:64] FLAG: --memory-manager-policy="None" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946640 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946644 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946647 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946650 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946658 2583 flags.go:64] FLAG: --node-status-max-images="50" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946660 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946663 2583 flags.go:64] FLAG: --oom-score-adj="-999" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946666 2583 flags.go:64] FLAG: --pod-cidr="" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946669 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946675 2583 flags.go:64] FLAG: --pod-manifest-path="" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946678 2583 flags.go:64] FLAG: --pod-max-pids="-1" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946682 2583 flags.go:64] FLAG: --pods-per-core="0" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946685 2583 flags.go:64] FLAG: --port="10250" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946688 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946690 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ef0c597779ced0e" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946693 2583 flags.go:64] FLAG: --qos-reserved="" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946696 2583 flags.go:64] FLAG: --read-only-port="10255" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946699 2583 flags.go:64] FLAG: --register-node="true" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946702 2583 flags.go:64] FLAG: --register-with-taints="" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946706 2583 flags.go:64] FLAG: --registry-burst="10" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946710 2583 flags.go:64] FLAG: --registry-qps="5" Aug 04 18:00:03.952894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946713 2583 flags.go:64] FLAG: --reserved-cpus="" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946715 2583 flags.go:64] FLAG: --reserved-memory="" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946719 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946722 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946725 2583 flags.go:64] FLAG: --rotate-certificates="false" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946728 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946731 2583 flags.go:64] FLAG: --runonce="false" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946733 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946737 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946740 2583 flags.go:64] FLAG: --seccomp-default="false" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946743 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946746 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946749 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946753 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946757 2583 flags.go:64] FLAG: --storage-driver-password="root" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946759 2583 flags.go:64] FLAG: --storage-driver-secure="false" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946762 2583 flags.go:64] FLAG: --storage-driver-table="stats" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946765 2583 flags.go:64] FLAG: --storage-driver-user="root" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946768 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946771 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946773 2583 flags.go:64] FLAG: --system-cgroups="" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946776 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946781 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946784 2583 flags.go:64] FLAG: --tls-cert-file="" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946787 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 04 18:00:03.953479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946791 2583 flags.go:64] FLAG: --tls-min-version="" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946794 2583 flags.go:64] FLAG: --tls-private-key-file="" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946797 2583 flags.go:64] FLAG: --topology-manager-policy="none" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946800 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946803 2583 flags.go:64] FLAG: --topology-manager-scope="container" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946806 2583 flags.go:64] FLAG: --v="2" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946811 2583 flags.go:64] FLAG: --version="false" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946816 2583 flags.go:64] FLAG: --vmodule="" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946819 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.946823 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946936 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946940 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946943 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946946 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946949 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946952 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946954 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946957 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946959 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946962 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946964 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 18:00:03.954084 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946967 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946970 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946974 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946977 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946980 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946984 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946988 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946991 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946993 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946996 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.946998 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947001 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947003 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947006 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947008 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947012 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947015 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947019 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 18:00:03.954595 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947022 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947025 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947027 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947033 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947036 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947039 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947041 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947044 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947046 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947049 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947051 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947054 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947057 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947059 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947062 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947066 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947068 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947071 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947073 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947076 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 18:00:03.955016 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947078 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947081 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947084 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947086 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947089 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947091 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947094 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947096 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947099 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947101 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947103 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947107 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947110 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947112 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947115 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947120 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947122 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947125 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947128 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947131 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 18:00:03.955483 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947133 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947136 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947138 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947141 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947144 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947146 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947149 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947151 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947154 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947157 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947159 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947162 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947165 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947167 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947170 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947173 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947175 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947177 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947180 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947183 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 18:00:03.956054 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947185 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947188 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947190 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947193 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947196 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947199 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947201 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947205 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947208 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.947210 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.947841 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.954202 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.954216 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.954238 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.954247 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 04 18:00:03.956527 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954299 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954305 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954308 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954312 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954315 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954318 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954321 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954324 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954327 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954329 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954332 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954335 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954337 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954340 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954343 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954346 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954348 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954351 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954355 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 18:00:03.956894 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954358 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954361 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954364 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954367 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954370 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954373 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954375 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954378 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954381 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954384 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954386 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954389 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954392 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954394 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954397 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954399 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954402 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954405 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954407 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954410 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 18:00:03.957346 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954413 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954415 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954418 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954421 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954423 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954426 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954428 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954431 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954433 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954436 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954440 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954444 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954446 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954449 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954452 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954455 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954458 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954460 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954463 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 18:00:03.957873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954466 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954470 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954473 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954476 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954479 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954482 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954485 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954487 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954490 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954492 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954495 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954497 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954517 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954521 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954524 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954527 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954530 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954533 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954536 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954539 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 18:00:03.958373 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954542 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954544 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954546 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954549 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954551 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954554 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954557 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954559 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954562 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954565 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954567 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954570 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954572 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954575 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954578 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954581 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954583 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954586 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954588 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954591 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 18:00:03.958873 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954593 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.954599 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954709 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954713 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954717 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954720 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954727 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954730 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954733 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954736 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954739 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954742 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954745 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954747 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 04 18:00:03.959659 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954750 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954754 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954757 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954759 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954762 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954764 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954767 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954770 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954772 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954775 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954778 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954780 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954783 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954786 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954789 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954792 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954795 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954797 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954799 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954803 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 04 18:00:03.960132 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954806 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954809 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954812 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954815 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954817 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954820 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954823 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954826 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954828 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954831 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954833 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954836 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954838 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954841 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954844 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954846 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954849 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954852 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954854 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954857 2583 feature_gate.go:328] unrecognized feature gate: Example2 Aug 04 18:00:03.960621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954859 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954861 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954864 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954867 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954869 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954872 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954874 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954877 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954879 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954882 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954884 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954887 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954889 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954891 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954894 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954896 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954900 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954903 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954907 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 04 18:00:03.961122 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954910 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954912 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954915 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954918 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954920 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954923 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954926 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954929 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954931 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954934 2583 feature_gate.go:328] unrecognized feature gate: Example Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954936 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954939 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954941 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954943 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954946 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954948 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954951 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954953 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954956 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954959 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 04 18:00:03.961587 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954961 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954964 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954966 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954969 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954972 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954974 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954977 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:03.954979 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.954984 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.955083 2583 server.go:962] "Client rotation is on, will bootstrap in background" Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.957703 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.958851 2583 server.go:1019] "Starting client certificate rotation" Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.958962 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 04 18:00:03.962196 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.959001 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 04 18:00:03.962538 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.962248 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 04 18:00:03.963807 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.963789 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 04 18:00:03.977380 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.977358 2583 log.go:25] "Validated CRI v1 runtime API" Aug 04 18:00:03.979711 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.979692 2583 log.go:25] "Validated CRI v1 image API" Aug 04 18:00:03.980400 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.980384 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 04 18:00:03.982808 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.982791 2583 fs.go:135] Filesystem UUIDs: map[2b98ac94-7c6a-4680-adbb-60a4c713a633:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bfe850e6-dfbd-4939-b423-e0d9f5214672:/dev/nvme0n1p3] Aug 04 18:00:03.982855 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.982808 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 04 18:00:03.988213 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.988107 2583 manager.go:216] Machine: {Timestamp:2026-08-04 18:00:03.986365466 +0000 UTC m=+0.289309383 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3209446 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea4700f1cdd0abf550226f4bca526 SystemUUID:ec2ea470-0f1c-dd0a-bf55-0226f4bca526 BootID:5e03f4a5-4c1e-41eb-ad1d-f6927a95494e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:90:c7:bd:02:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:90:c7:bd:02:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:71:90:8a:01:7b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 04 18:00:03.988213 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.988209 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 04 18:00:03.988310 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.988285 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 04 18:00:03.990795 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.990772 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 04 18:00:03.990935 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.990800 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-51.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 04 18:00:03.991974 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.991964 2583 topology_manager.go:138] "Creating topology manager with none policy" Aug 04 18:00:03.992007 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.991977 2583 container_manager_linux.go:309] "Creating device plugin manager" Aug 04 18:00:03.992007 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.991984 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 04 18:00:03.992555 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.992544 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 04 18:00:03.993270 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.993259 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 04 18:00:03.993305 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.993261 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 04 18:00:03.996600 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.996588 2583 state_mem.go:36] "Initialized new in-memory state store" Aug 04 18:00:03.996721 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.996711 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 04 18:00:03.996775 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.996766 2583 kubelet.go:486] "Attempting to sync node with API server" Aug 04 18:00:03.996806 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.996780 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 04 18:00:03.996806 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.996790 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 04 18:00:03.996806 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.996799 2583 kubelet.go:398] "Adding apiserver pod source" Aug 04 18:00:03.996899 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.996807 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 04 18:00:03.997148 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.997137 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 04 18:00:03.997188 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.997154 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 04 18:00:03.999453 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:03.999432 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 04 18:00:04.000922 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.000907 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 04 18:00:04.000978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.000937 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 04 18:00:04.001894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001882 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 04 18:00:04.001945 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001898 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 04 18:00:04.001945 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001905 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 04 18:00:04.001945 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001910 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 04 18:00:04.001945 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001923 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 04 18:00:04.001945 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001932 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 04 18:00:04.001945 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001941 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 04 18:00:04.001945 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001946 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 04 18:00:04.002121 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001954 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 04 18:00:04.002121 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001959 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 04 18:00:04.002121 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001972 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 04 18:00:04.002121 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.001978 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 04 18:00:04.002121 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.002001 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 04 18:00:04.002121 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.002009 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 04 18:00:04.005029 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.005017 2583 server.go:1268] "Started kubelet" Aug 04 18:00:04.005146 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.005109 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 04 18:00:04.005243 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.005092 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 04 18:00:04.005408 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.005290 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 04 18:00:04.005904 ip-10-0-128-51 systemd[1]: Started Kubernetes Kubelet. Aug 04 18:00:04.008611 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.008173 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 04 18:00:04.008705 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.008659 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-51.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 04 18:00:04.009457 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.009424 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 04 18:00:04.009633 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.009411 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 04 18:00:04.009987 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.009969 2583 server.go:310] "Adding debug handlers to kubelet server" Aug 04 18:00:04.010153 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.010134 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 04 18:00:04.012147 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.011408 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-51.ec2.internal.18c8ac08530592a7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-51.ec2.internal,UID:ip-10-0-128-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-51.ec2.internal,},FirstTimestamp:2026-08-04 18:00:04.004991655 +0000 UTC m=+0.307935571,LastTimestamp:2026-08-04 18:00:04.004991655 +0000 UTC m=+0.307935571,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-51.ec2.internal,}" Aug 04 18:00:04.013376 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.013363 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 04 18:00:04.013439 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.013371 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 04 18:00:04.013486 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.013452 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.013898 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.013883 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 04 18:00:04.013898 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.013884 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 04 18:00:04.014028 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.013910 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 04 18:00:04.014028 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.013988 2583 reconstruct.go:97] "Volume reconstruction finished" Aug 04 18:00:04.014028 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.013996 2583 reconciler.go:29] "Reconciler: start to sync state" Aug 04 18:00:04.014137 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.014113 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 04 18:00:04.014137 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.014127 2583 factory.go:55] Registering systemd factory Aug 04 18:00:04.014137 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.014137 2583 factory.go:223] Registration of the systemd container factory successfully Aug 04 18:00:04.014360 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.014343 2583 factory.go:153] Registering CRI-O factory Aug 04 18:00:04.014431 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.014362 2583 factory.go:223] Registration of the crio container factory successfully Aug 04 18:00:04.014431 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.014385 2583 factory.go:103] Registering Raw factory Aug 04 18:00:04.014431 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.014402 2583 manager.go:1196] Started watching for new ooms in manager Aug 04 18:00:04.014876 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.014860 2583 manager.go:349] Starting recovery of all containers Aug 04 18:00:04.021375 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.021347 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 04 18:00:04.021708 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.021684 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 04 18:00:04.022012 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.021984 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 04 18:00:04.025298 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.025283 2583 manager.go:354] Recovery completed Aug 04 18:00:04.029392 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.029381 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 18:00:04.030978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.030957 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientMemory" Aug 04 18:00:04.031047 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.030990 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 18:00:04.031047 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.031002 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientPID" Aug 04 18:00:04.031484 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.031469 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 18:00:04.031579 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.031469 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 04 18:00:04.031579 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.031529 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 04 18:00:04.031579 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.031550 2583 state_mem.go:36] "Initialized new in-memory state store" Aug 04 18:00:04.032105 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.032089 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientMemory" Aug 04 18:00:04.032156 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.032115 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 18:00:04.032156 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.032125 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientPID" Aug 04 18:00:04.033112 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.033100 2583 policy_none.go:49] "None policy: Start" Aug 04 18:00:04.033160 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.033116 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 04 18:00:04.033160 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.033126 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 04 18:00:04.033160 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.033072 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-51.ec2.internal.18c8ac0854921618 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-51.ec2.internal,UID:ip-10-0-128-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-51.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-51.ec2.internal,},FirstTimestamp:2026-08-04 18:00:04.03097756 +0000 UTC m=+0.333921475,LastTimestamp:2026-08-04 18:00:04.03097756 +0000 UTC m=+0.333921475,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-51.ec2.internal,}" Aug 04 18:00:04.034573 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.034562 2583 policy_none.go:47] "Start" Aug 04 18:00:04.039165 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.039017 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gg5vz" Aug 04 18:00:04.041077 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.041010 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-51.ec2.internal.18c8ac0854925941 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-51.ec2.internal,UID:ip-10-0-128-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-51.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-51.ec2.internal,},FirstTimestamp:2026-08-04 18:00:04.030994753 +0000 UTC m=+0.333938669,LastTimestamp:2026-08-04 18:00:04.030994753 +0000 UTC m=+0.333938669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-51.ec2.internal,}" Aug 04 18:00:04.042837 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.042786 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-51.ec2.internal.18c8ac0854928bfc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-51.ec2.internal,UID:ip-10-0-128-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-51.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-51.ec2.internal,},FirstTimestamp:2026-08-04 18:00:04.03100774 +0000 UTC m=+0.333951658,LastTimestamp:2026-08-04 18:00:04.03100774 +0000 UTC m=+0.333951658,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-51.ec2.internal,}" Aug 04 18:00:04.047752 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.047730 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gg5vz" Aug 04 18:00:04.050863 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.050805 2583 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-51.ec2.internal.18c8ac0854921618\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-51.ec2.internal.18c8ac0854921618 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-51.ec2.internal,UID:ip-10-0-128-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-51.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-51.ec2.internal,},FirstTimestamp:2026-08-04 18:00:04.03097756 +0000 UTC m=+0.333921475,LastTimestamp:2026-08-04 18:00:04.032104182 +0000 UTC m=+0.335048098,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-51.ec2.internal,}" Aug 04 18:00:04.072605 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.072591 2583 manager.go:337] "Starting Device Plugin manager" Aug 04 18:00:04.072693 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.072626 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 04 18:00:04.072693 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.072638 2583 server.go:87] "Starting device plugin registration server" Aug 04 18:00:04.072881 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.072868 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 04 18:00:04.072954 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.072885 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 04 18:00:04.072998 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.072962 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 04 18:00:04.073055 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.073046 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 04 18:00:04.073102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.073055 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 04 18:00:04.073579 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.073559 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 04 18:00:04.073635 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.073602 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.149399 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.149375 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 04 18:00:04.150470 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.149415 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 04 18:00:04.150470 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.149440 2583 kubelet.go:2448] "Starting kubelet main sync loop" Aug 04 18:00:04.150470 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.149469 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 04 18:00:04.152320 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.152299 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 18:00:04.173477 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.173462 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 18:00:04.174248 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.174230 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientMemory" Aug 04 18:00:04.174310 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.174264 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 18:00:04.174310 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.174275 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientPID" Aug 04 18:00:04.174310 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.174298 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.182469 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.182454 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.182566 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.182479 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-51.ec2.internal\": node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.196205 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.196145 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.250491 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.250442 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal"] Aug 04 18:00:04.250641 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.250546 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 18:00:04.251442 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.251426 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientMemory" Aug 04 18:00:04.251548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.251458 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 18:00:04.251548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.251473 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientPID" Aug 04 18:00:04.252771 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.252756 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 18:00:04.252877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.252862 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.252925 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.252894 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 18:00:04.253441 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.253427 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientMemory" Aug 04 18:00:04.253499 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.253454 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 18:00:04.253499 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.253465 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientPID" Aug 04 18:00:04.253611 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.253428 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientMemory" Aug 04 18:00:04.253611 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.253533 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 18:00:04.253611 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.253546 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientPID" Aug 04 18:00:04.254838 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.254822 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.254882 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.254852 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 18:00:04.256080 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.256063 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientMemory" Aug 04 18:00:04.256200 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.256097 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 18:00:04.256200 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.256110 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientPID" Aug 04 18:00:04.276090 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.276069 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-51.ec2.internal\" not found" node="ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.279933 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.279915 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-51.ec2.internal\" not found" node="ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.296231 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.296210 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.316205 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.316181 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f69fc9e0b3bb68d48b82a7e4d504e25f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal\" (UID: \"f69fc9e0b3bb68d48b82a7e4d504e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.316297 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.316215 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f69fc9e0b3bb68d48b82a7e4d504e25f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal\" (UID: \"f69fc9e0b3bb68d48b82a7e4d504e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.316297 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.316243 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c82be4bfc3f07367942d8a0fb59c52b4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-51.ec2.internal\" (UID: \"c82be4bfc3f07367942d8a0fb59c52b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.397134 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.397108 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.416403 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.416372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f69fc9e0b3bb68d48b82a7e4d504e25f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal\" (UID: \"f69fc9e0b3bb68d48b82a7e4d504e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.416542 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.416409 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f69fc9e0b3bb68d48b82a7e4d504e25f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal\" (UID: \"f69fc9e0b3bb68d48b82a7e4d504e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.416542 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.416436 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c82be4bfc3f07367942d8a0fb59c52b4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-51.ec2.internal\" (UID: \"c82be4bfc3f07367942d8a0fb59c52b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.416542 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.416487 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f69fc9e0b3bb68d48b82a7e4d504e25f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal\" (UID: \"f69fc9e0b3bb68d48b82a7e4d504e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.416542 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.416495 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f69fc9e0b3bb68d48b82a7e4d504e25f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal\" (UID: \"f69fc9e0b3bb68d48b82a7e4d504e25f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.416677 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.416559 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c82be4bfc3f07367942d8a0fb59c52b4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-51.ec2.internal\" (UID: \"c82be4bfc3f07367942d8a0fb59c52b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.499345 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.499272 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.583167 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.583124 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.583256 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.583150 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal" Aug 04 18:00:04.599873 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.599849 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.705120 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.705063 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.805492 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.805406 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.905923 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:04.905879 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:04.961111 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.961078 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 04 18:00:04.961622 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:04.961323 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 04 18:00:05.006276 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:05.006228 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:05.051607 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.051565 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 17:55:04 +0000 UTC" deadline="2028-05-08 02:41:52.270999378 +0000 UTC" Aug 04 18:00:05.051607 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.051598 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15416h41m47.219404693s" Aug 04 18:00:05.108177 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:05.108108 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:05.208965 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:05.208926 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:05.212346 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.212326 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 04 18:00:05.213355 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.213335 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientMemory" Aug 04 18:00:05.213442 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.213367 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasNoDiskPressure" Aug 04 18:00:05.213442 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.213380 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeHasSufficientPID" Aug 04 18:00:05.314769 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:05.314721 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:05.343490 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.343468 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 18:00:05.418574 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:05.418497 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-51.ec2.internal\" not found" Aug 04 18:00:05.512431 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.512408 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 18:00:05.514156 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.514138 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" Aug 04 18:00:05.525675 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.525654 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 04 18:00:05.527606 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.527590 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal" Aug 04 18:00:05.539383 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.539358 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 04 18:00:05.539532 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.539510 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 18:00:05.865945 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:05.865858 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 04 18:00:06.000194 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.000157 2583 apiserver.go:52] "Watching apiserver" Aug 04 18:00:06.009835 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.009799 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 04 18:00:06.010184 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.010162 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-mc2gz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal","openshift-multus/multus-8bjfh","openshift-multus/multus-additional-cni-plugins-8nwkj","openshift-multus/network-metrics-daemon-5brj6","openshift-ovn-kubernetes/ovnkube-node-dwhtp","kube-system/global-pull-secret-syncer-w8bqx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw","openshift-dns/node-resolver-vn24x","openshift-image-registry/node-ca-n8zd2","openshift-network-diagnostics/network-check-target-q7ttb","openshift-network-operator/iptables-alerter-n2dmv","kube-system/konnectivity-agent-qprpr","kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal"] Aug 04 18:00:06.011817 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.011801 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.011906 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.011884 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:06.013057 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.013027 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:06.014204 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.014185 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.014325 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.014188 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 04 18:00:06.015395 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.015379 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.016199 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.016183 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5kvpk\"" Aug 04 18:00:06.016351 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.016335 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 04 18:00:06.016602 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.016584 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:06.016666 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.016650 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:06.016830 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.016815 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 04 18:00:06.017552 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.017537 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 04 18:00:06.017772 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.017754 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 04 18:00:06.017897 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.017884 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.018280 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.018255 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 04 18:00:06.018378 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.018326 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 04 18:00:06.018378 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.018365 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 04 18:00:06.018508 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.018416 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8pqkl\"" Aug 04 18:00:06.018508 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.018416 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 04 18:00:06.018612 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.018517 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nl6qp\"" Aug 04 18:00:06.019285 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.019270 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.020121 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.020102 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 04 18:00:06.020121 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.020113 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kg7f4\"" Aug 04 18:00:06.020361 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.020343 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 04 18:00:06.020361 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.020355 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 04 18:00:06.020681 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.020667 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.022237 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.021965 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.022368 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.022351 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 04 18:00:06.022411 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.022359 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-md8rz\"" Aug 04 18:00:06.022930 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.022911 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-cni-dir\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023013 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.022958 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-run-k8s-cni-cncf-io\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023013 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.022985 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-run-netns\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023013 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.022999 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 04 18:00:06.023167 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgnbv\" (UniqueName: \"kubernetes.io/projected/d8db9569-f0a2-47f8-a876-839d7dcbfdab-kube-api-access-kgnbv\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023167 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023052 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab7a4076-baf9-4296-a630-843220f1341c-dbus\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.023167 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023118 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 04 18:00:06.023167 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023121 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.023167 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023161 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-system-cni-dir\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023187 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8db9569-f0a2-47f8-a876-839d7dcbfdab-cni-binary-copy\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023213 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-socket-dir-parent\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023239 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-var-lib-cni-multus\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-hostroot\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023274 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 04 18:00:06.023413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023293 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5d518ae-f261-4144-9854-a18ba566698e-agent-certs\") pod \"konnectivity-agent-qprpr\" (UID: \"a5d518ae-f261-4144-9854-a18ba566698e\") " pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:06.023413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023338 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5d518ae-f261-4144-9854-a18ba566698e-konnectivity-ca\") pod \"konnectivity-agent-qprpr\" (UID: \"a5d518ae-f261-4144-9854-a18ba566698e\") " pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:06.023413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023371 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-cnibin\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023396 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-var-lib-kubelet\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-conf-dir\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023451 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023462 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-run-multus-certs\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023539 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-etc-kubernetes\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023589 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023603 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab7a4076-baf9-4296-a630-843220f1341c-kubelet-config\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023647 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-os-release\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023689 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-var-lib-cni-bin\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023719 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-daemon-config\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.023847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023770 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.024243 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.023992 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 04 18:00:06.024243 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.024154 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ddwcv\"" Aug 04 18:00:06.024341 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.024308 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 04 18:00:06.024341 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.024325 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 04 18:00:06.024341 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.024328 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 04 18:00:06.024729 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.024710 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4sgws\"" Aug 04 18:00:06.025433 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.025415 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:06.026033 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.025669 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:06.026234 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.026216 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 04 18:00:06.026330 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.026222 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8s822\"" Aug 04 18:00:06.026420 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.026378 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 04 18:00:06.026848 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.026823 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 04 18:00:06.027393 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.027375 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.030209 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.030194 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 04 18:00:06.030281 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.030217 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 04 18:00:06.030333 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.030217 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 04 18:00:06.030333 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.030219 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mpjq8\"" Aug 04 18:00:06.031888 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.031636 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 04 18:00:06.113331 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.113308 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rt4mr" Aug 04 18:00:06.116074 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.116026 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 04 18:00:06.121485 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.121462 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rt4mr" Aug 04 18:00:06.123901 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.123878 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/836f56fd-94e7-4229-9744-eddcf05a40fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.123995 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.123912 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rdkb\" (UniqueName: \"kubernetes.io/projected/836f56fd-94e7-4229-9744-eddcf05a40fd-kube-api-access-9rdkb\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.123995 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.123939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-sysconfig\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.123995 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.123978 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.124120 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124014 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-device-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.124120 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124037 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-sys-fs\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.124120 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124069 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5d518ae-f261-4144-9854-a18ba566698e-konnectivity-ca\") pod \"konnectivity-agent-qprpr\" (UID: \"a5d518ae-f261-4144-9854-a18ba566698e\") " pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:06.124120 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124090 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-cnibin\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.124120 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124110 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab7a4076-baf9-4296-a630-843220f1341c-kubelet-config\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.124360 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124223 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-slash\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.124360 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124239 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-cni-bin\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.124360 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124288 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ab7a4076-baf9-4296-a630-843220f1341c-kubelet-config\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.124360 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124296 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-etc-selinux\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.124360 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124324 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-cnibin\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.124360 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124336 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-os-release\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.124683 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124393 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-os-release\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.124683 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124432 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-daemon-config\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.124683 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124468 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/836f56fd-94e7-4229-9744-eddcf05a40fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.124683 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124575 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab7a4076-baf9-4296-a630-843220f1341c-dbus\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.124683 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124613 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-node-log\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.124683 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124639 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83c7dd22-1e03-4b09-a372-2cddfbbafb32-serviceca\") pod \"node-ca-n8zd2\" (UID: \"83c7dd22-1e03-4b09-a372-2cddfbbafb32\") " pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.124683 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124666 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-socket-dir-parent\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.124683 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124680 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a5d518ae-f261-4144-9854-a18ba566698e-konnectivity-ca\") pod \"konnectivity-agent-qprpr\" (UID: \"a5d518ae-f261-4144-9854-a18ba566698e\") " pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124690 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-run-openvswitch\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124715 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8edbbe9e-2d52-43b5-8098-a964b3b88df1-env-overrides\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124741 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ab7a4076-baf9-4296-a630-843220f1341c-dbus\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124757 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-var-lib-kubelet\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124787 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-tuned\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124757 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-socket-dir-parent\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124810 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124848 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5d518ae-f261-4144-9854-a18ba566698e-agent-certs\") pod \"konnectivity-agent-qprpr\" (UID: \"a5d518ae-f261-4144-9854-a18ba566698e\") " pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-cni-netd\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124903 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8edbbe9e-2d52-43b5-8098-a964b3b88df1-ovnkube-config\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124936 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv5rb\" (UniqueName: \"kubernetes.io/projected/83c7dd22-1e03-4b09-a372-2cddfbbafb32-kube-api-access-sv5rb\") pod \"node-ca-n8zd2\" (UID: \"83c7dd22-1e03-4b09-a372-2cddfbbafb32\") " pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124950 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-daemon-config\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124966 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/836f56fd-94e7-4229-9744-eddcf05a40fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.124991 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-sysctl-d\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.125016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125017 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-run\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125040 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-sys\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125065 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-var-lib-cni-bin\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125091 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-run-systemd\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125132 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-run-ovn-kubernetes\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125162 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-var-lib-cni-bin\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125165 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v97wz\" (UniqueName: \"kubernetes.io/projected/349d54df-5bd2-4a3f-8d94-25c6ec118a46-kube-api-access-v97wz\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-run-netns\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125230 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125261 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27c0e506-b7da-4130-acac-c0140c7a8a18-hosts-file\") pod \"node-resolver-vn24x\" (UID: \"27c0e506-b7da-4130-acac-c0140c7a8a18\") " pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125280 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-var-lib-cni-multus\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125274 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125310 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-var-lib-cni-multus\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125316 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8edbbe9e-2d52-43b5-8098-a964b3b88df1-ovn-node-metrics-cert\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125354 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-sysctl-conf\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125387 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-run-multus-certs\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125435 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-run-multus-certs\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.125759 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125445 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-etc-kubernetes\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125471 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-etc-openvswitch\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125482 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-etc-kubernetes\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125487 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-cnibin\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125504 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fbtc\" (UniqueName: \"kubernetes.io/projected/27c0e506-b7da-4130-acac-c0140c7a8a18-kube-api-access-6fbtc\") pod \"node-resolver-vn24x\" (UID: \"27c0e506-b7da-4130-acac-c0140c7a8a18\") " pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125543 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-systemd-units\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125571 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-run-ovn\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125593 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8edbbe9e-2d52-43b5-8098-a964b3b88df1-ovnkube-script-lib\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125609 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20f878b7-ee83-4358-b162-228e59040a8b-host-slash\") pod \"iptables-alerter-n2dmv\" (UID: \"20f878b7-ee83-4358-b162-228e59040a8b\") " pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-systemd\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125651 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-tmp\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125672 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-run-netns\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125687 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-kubelet\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125701 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-log-socket\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125723 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20f878b7-ee83-4358-b162-228e59040a8b-iptables-alerter-script\") pod \"iptables-alerter-n2dmv\" (UID: \"20f878b7-ee83-4358-b162-228e59040a8b\") " pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125760 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-system-cni-dir\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125755 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-run-netns\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.126319 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125827 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-system-cni-dir\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125853 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-hostroot\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125877 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-var-lib-openvswitch\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125887 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-hostroot\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125894 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83c7dd22-1e03-4b09-a372-2cddfbbafb32-host\") pod \"node-ca-n8zd2\" (UID: \"83c7dd22-1e03-4b09-a372-2cddfbbafb32\") " pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125929 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-kubernetes\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-lib-modules\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125971 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-socket-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.125996 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrnqq\" (UniqueName: \"kubernetes.io/projected/de1ce6c4-0fce-45c9-af1d-c1c526082161-kube-api-access-nrnqq\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126036 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-var-lib-kubelet\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126069 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-conf-dir\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126093 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-conf-dir\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126097 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126071 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-var-lib-kubelet\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126128 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27c0e506-b7da-4130-acac-c0140c7a8a18-tmp-dir\") pod \"node-resolver-vn24x\" (UID: \"27c0e506-b7da-4130-acac-c0140c7a8a18\") " pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126144 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-modprobe-d\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126161 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-host\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.127034 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126177 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-registration-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126191 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wht5c\" (UniqueName: \"kubernetes.io/projected/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-kube-api-access-wht5c\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126222 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126254 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-cni-dir\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-run-k8s-cni-cncf-io\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126305 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgnbv\" (UniqueName: \"kubernetes.io/projected/d8db9569-f0a2-47f8-a876-839d7dcbfdab-kube-api-access-kgnbv\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126321 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-multus-cni-dir\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126334 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126362 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8db9569-f0a2-47f8-a876-839d7dcbfdab-host-run-k8s-cni-cncf-io\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126363 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvpkd\" (UniqueName: \"kubernetes.io/projected/8edbbe9e-2d52-43b5-8098-a964b3b88df1-kube-api-access-cvpkd\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126389 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48wb8\" (UniqueName: \"kubernetes.io/projected/20f878b7-ee83-4358-b162-228e59040a8b-kube-api-access-48wb8\") pod \"iptables-alerter-n2dmv\" (UID: \"20f878b7-ee83-4358-b162-228e59040a8b\") " pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126422 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-system-cni-dir\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126439 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8db9569-f0a2-47f8-a876-839d7dcbfdab-cni-binary-copy\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126454 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-os-release\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.126455 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.126576 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret podName:ab7a4076-baf9-4296-a630-843220f1341c nodeName:}" failed. No retries permitted until 2026-08-04 18:00:06.626520923 +0000 UTC m=+2.929464847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret") pod "global-pull-secret-syncer-w8bqx" (UID: "ab7a4076-baf9-4296-a630-843220f1341c") : object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:06.127877 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.126866 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8db9569-f0a2-47f8-a876-839d7dcbfdab-cni-binary-copy\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.128875 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.128856 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a5d518ae-f261-4144-9854-a18ba566698e-agent-certs\") pod \"konnectivity-agent-qprpr\" (UID: \"a5d518ae-f261-4144-9854-a18ba566698e\") " pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:06.141747 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.141722 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgnbv\" (UniqueName: \"kubernetes.io/projected/d8db9569-f0a2-47f8-a876-839d7dcbfdab-kube-api-access-kgnbv\") pod \"multus-8bjfh\" (UID: \"d8db9569-f0a2-47f8-a876-839d7dcbfdab\") " pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.203442 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.203393 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69fc9e0b3bb68d48b82a7e4d504e25f.slice/crio-28bfadf93dcd3a8cf13fd16463d39b24c3d0ab897b721d06449deacc9a8bf0c8 WatchSource:0}: Error finding container 28bfadf93dcd3a8cf13fd16463d39b24c3d0ab897b721d06449deacc9a8bf0c8: Status 404 returned error can't find the container with id 28bfadf93dcd3a8cf13fd16463d39b24c3d0ab897b721d06449deacc9a8bf0c8 Aug 04 18:00:06.207296 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.207280 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 18:00:06.226865 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.226834 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-slash\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.226978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.226868 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-cni-bin\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.226978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.226886 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-etc-selinux\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.226978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.226923 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/836f56fd-94e7-4229-9744-eddcf05a40fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.226978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.226951 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-slash\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.226978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.226963 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-node-log\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.226978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.226972 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-etc-selinux\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.226978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.226971 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-cni-bin\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.227208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227001 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-node-log\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.227208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227000 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83c7dd22-1e03-4b09-a372-2cddfbbafb32-serviceca\") pod \"node-ca-n8zd2\" (UID: \"83c7dd22-1e03-4b09-a372-2cddfbbafb32\") " pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.227208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-run-openvswitch\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.227208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227062 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8edbbe9e-2d52-43b5-8098-a964b3b88df1-env-overrides\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.227208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227095 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-run-openvswitch\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.227208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227110 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-var-lib-kubelet\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.227208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-tuned\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.227208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227159 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227219 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-var-lib-kubelet\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227261 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-cni-netd\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227309 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8edbbe9e-2d52-43b5-8098-a964b3b88df1-ovnkube-config\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227334 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv5rb\" (UniqueName: \"kubernetes.io/projected/83c7dd22-1e03-4b09-a372-2cddfbbafb32-kube-api-access-sv5rb\") pod \"node-ca-n8zd2\" (UID: \"83c7dd22-1e03-4b09-a372-2cddfbbafb32\") " pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227362 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/836f56fd-94e7-4229-9744-eddcf05a40fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227386 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-sysctl-d\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227396 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-cni-netd\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227421 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-run\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227445 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-sys\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227469 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-run-systemd\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227505 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83c7dd22-1e03-4b09-a372-2cddfbbafb32-serviceca\") pod \"node-ca-n8zd2\" (UID: \"83c7dd22-1e03-4b09-a372-2cddfbbafb32\") " pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.227536 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227534 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/836f56fd-94e7-4229-9744-eddcf05a40fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227594 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-sys\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227602 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-run\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227602 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-run-ovn-kubernetes\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227614 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8edbbe9e-2d52-43b5-8098-a964b3b88df1-env-overrides\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227637 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-run-systemd\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227500 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-run-ovn-kubernetes\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227681 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v97wz\" (UniqueName: \"kubernetes.io/projected/349d54df-5bd2-4a3f-8d94-25c6ec118a46-kube-api-access-v97wz\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227705 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-run-netns\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227715 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-sysctl-d\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227754 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227780 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27c0e506-b7da-4130-acac-c0140c7a8a18-hosts-file\") pod \"node-resolver-vn24x\" (UID: \"27c0e506-b7da-4130-acac-c0140c7a8a18\") " pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227812 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8edbbe9e-2d52-43b5-8098-a964b3b88df1-ovn-node-metrics-cert\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-sysctl-conf\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227884 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227920 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-etc-openvswitch\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-cnibin\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.228181 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227951 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27c0e506-b7da-4130-acac-c0140c7a8a18-hosts-file\") pod \"node-resolver-vn24x\" (UID: \"27c0e506-b7da-4130-acac-c0140c7a8a18\") " pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227957 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-sysctl-conf\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227970 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fbtc\" (UniqueName: \"kubernetes.io/projected/27c0e506-b7da-4130-acac-c0140c7a8a18-kube-api-access-6fbtc\") pod \"node-resolver-vn24x\" (UID: \"27c0e506-b7da-4130-acac-c0140c7a8a18\") " pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.227997 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-systemd-units\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228001 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-run-netns\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228014 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-cnibin\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228024 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-run-ovn\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228042 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-etc-openvswitch\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228049 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8edbbe9e-2d52-43b5-8098-a964b3b88df1-ovnkube-script-lib\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228051 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/836f56fd-94e7-4229-9744-eddcf05a40fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228124 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20f878b7-ee83-4358-b162-228e59040a8b-host-slash\") pod \"iptables-alerter-n2dmv\" (UID: \"20f878b7-ee83-4358-b162-228e59040a8b\") " pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228134 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-run-ovn\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228072 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/20f878b7-ee83-4358-b162-228e59040a8b-host-slash\") pod \"iptables-alerter-n2dmv\" (UID: \"20f878b7-ee83-4358-b162-228e59040a8b\") " pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228169 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-systemd\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228174 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-systemd-units\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228140 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8edbbe9e-2d52-43b5-8098-a964b3b88df1-ovnkube-config\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228212 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-tmp\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228225 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-systemd\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.229031 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228239 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-kubelet\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228263 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-log-socket\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228287 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20f878b7-ee83-4358-b162-228e59040a8b-iptables-alerter-script\") pod \"iptables-alerter-n2dmv\" (UID: \"20f878b7-ee83-4358-b162-228e59040a8b\") " pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228313 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-var-lib-openvswitch\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228322 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-host-kubelet\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228334 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83c7dd22-1e03-4b09-a372-2cddfbbafb32-host\") pod \"node-ca-n8zd2\" (UID: \"83c7dd22-1e03-4b09-a372-2cddfbbafb32\") " pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228366 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-kubernetes\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228397 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-var-lib-openvswitch\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228402 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-lib-modules\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228367 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83c7dd22-1e03-4b09-a372-2cddfbbafb32-host\") pod \"node-ca-n8zd2\" (UID: \"83c7dd22-1e03-4b09-a372-2cddfbbafb32\") " pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228431 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-socket-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228455 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-kubernetes\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228455 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrnqq\" (UniqueName: \"kubernetes.io/projected/de1ce6c4-0fce-45c9-af1d-c1c526082161-kube-api-access-nrnqq\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228490 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228515 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27c0e506-b7da-4130-acac-c0140c7a8a18-tmp-dir\") pod \"node-resolver-vn24x\" (UID: \"27c0e506-b7da-4130-acac-c0140c7a8a18\") " pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228544 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-socket-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228561 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-modprobe-d\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.229913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228585 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-host\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228611 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-registration-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228635 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wht5c\" (UniqueName: \"kubernetes.io/projected/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-kube-api-access-wht5c\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228659 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-lib-modules\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228666 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8edbbe9e-2d52-43b5-8098-a964b3b88df1-ovnkube-script-lib\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228660 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.228739 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.228805 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs podName:349d54df-5bd2-4a3f-8d94-25c6ec118a46 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:06.72878705 +0000 UTC m=+3.031730960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs") pod "network-metrics-daemon-5brj6" (UID: "349d54df-5bd2-4a3f-8d94-25c6ec118a46") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228903 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/20f878b7-ee83-4358-b162-228e59040a8b-iptables-alerter-script\") pod \"iptables-alerter-n2dmv\" (UID: \"20f878b7-ee83-4358-b162-228e59040a8b\") " pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228919 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27c0e506-b7da-4130-acac-c0140c7a8a18-tmp-dir\") pod \"node-resolver-vn24x\" (UID: \"27c0e506-b7da-4130-acac-c0140c7a8a18\") " pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228962 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-modprobe-d\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228995 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8edbbe9e-2d52-43b5-8098-a964b3b88df1-log-socket\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.228737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvpkd\" (UniqueName: \"kubernetes.io/projected/8edbbe9e-2d52-43b5-8098-a964b3b88df1-kube-api-access-cvpkd\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229039 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wb8\" (UniqueName: \"kubernetes.io/projected/20f878b7-ee83-4358-b162-228e59040a8b-kube-api-access-48wb8\") pod \"iptables-alerter-n2dmv\" (UID: \"20f878b7-ee83-4358-b162-228e59040a8b\") " pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229066 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-system-cni-dir\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229092 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229094 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-os-release\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.230548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229133 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-host\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229145 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-registration-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229163 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-os-release\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/836f56fd-94e7-4229-9744-eddcf05a40fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229203 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/836f56fd-94e7-4229-9744-eddcf05a40fd-system-cni-dir\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229206 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rdkb\" (UniqueName: \"kubernetes.io/projected/836f56fd-94e7-4229-9744-eddcf05a40fd-kube-api-access-9rdkb\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229232 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-sysconfig\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229258 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229283 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-device-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229310 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-sys-fs\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229370 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229385 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-sys-fs\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229426 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-sysconfig\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.229428 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de1ce6c4-0fce-45c9-af1d-c1c526082161-device-dir\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.230083 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-etc-tuned\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.230129 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/836f56fd-94e7-4229-9744-eddcf05a40fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.230569 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-tmp\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.231102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.230578 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8edbbe9e-2d52-43b5-8098-a964b3b88df1-ovn-node-metrics-cert\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.239277 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.239257 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 18:00:06.239327 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.239280 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 18:00:06.239327 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.239290 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9cf89 for pod openshift-network-diagnostics/network-check-target-q7ttb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:06.239396 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.239344 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89 podName:ae52f154-23ed-4d15-adf7-84bc6f4e80e0 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:06.739331205 +0000 UTC m=+3.042275111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9cf89" (UniqueName: "kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89") pod "network-check-target-q7ttb" (UID: "ae52f154-23ed-4d15-adf7-84bc6f4e80e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:06.244530 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.244503 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvpkd\" (UniqueName: \"kubernetes.io/projected/8edbbe9e-2d52-43b5-8098-a964b3b88df1-kube-api-access-cvpkd\") pod \"ovnkube-node-dwhtp\" (UID: \"8edbbe9e-2d52-43b5-8098-a964b3b88df1\") " pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.245129 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.245107 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv5rb\" (UniqueName: \"kubernetes.io/projected/83c7dd22-1e03-4b09-a372-2cddfbbafb32-kube-api-access-sv5rb\") pod \"node-ca-n8zd2\" (UID: \"83c7dd22-1e03-4b09-a372-2cddfbbafb32\") " pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.245312 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.245296 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fbtc\" (UniqueName: \"kubernetes.io/projected/27c0e506-b7da-4130-acac-c0140c7a8a18-kube-api-access-6fbtc\") pod \"node-resolver-vn24x\" (UID: \"27c0e506-b7da-4130-acac-c0140c7a8a18\") " pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.245666 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.245638 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v97wz\" (UniqueName: \"kubernetes.io/projected/349d54df-5bd2-4a3f-8d94-25c6ec118a46-kube-api-access-v97wz\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:06.247857 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.247830 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rdkb\" (UniqueName: \"kubernetes.io/projected/836f56fd-94e7-4229-9744-eddcf05a40fd-kube-api-access-9rdkb\") pod \"multus-additional-cni-plugins-8nwkj\" (UID: \"836f56fd-94e7-4229-9744-eddcf05a40fd\") " pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.248517 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.248496 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrnqq\" (UniqueName: \"kubernetes.io/projected/de1ce6c4-0fce-45c9-af1d-c1c526082161-kube-api-access-nrnqq\") pod \"aws-ebs-csi-driver-node-xv7gw\" (UID: \"de1ce6c4-0fce-45c9-af1d-c1c526082161\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.249799 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.249780 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48wb8\" (UniqueName: \"kubernetes.io/projected/20f878b7-ee83-4358-b162-228e59040a8b-kube-api-access-48wb8\") pod \"iptables-alerter-n2dmv\" (UID: \"20f878b7-ee83-4358-b162-228e59040a8b\") " pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.250045 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.250024 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wht5c\" (UniqueName: \"kubernetes.io/projected/041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44-kube-api-access-wht5c\") pod \"tuned-mc2gz\" (UID: \"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44\") " pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.339936 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.339901 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:06.349316 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.349285 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d518ae_f261_4144_9854_a18ba566698e.slice/crio-26a141941596546cdb8716611bc7e599027b4a12ad07fceb0716d620874c00f1 WatchSource:0}: Error finding container 26a141941596546cdb8716611bc7e599027b4a12ad07fceb0716d620874c00f1: Status 404 returned error can't find the container with id 26a141941596546cdb8716611bc7e599027b4a12ad07fceb0716d620874c00f1 Aug 04 18:00:06.360210 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.360189 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8bjfh" Aug 04 18:00:06.365286 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.365265 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" Aug 04 18:00:06.367621 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.367565 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8db9569_f0a2_47f8_a876_839d7dcbfdab.slice/crio-321c5f8b8b56fc9eb7060f0dec783c121c55f7389da385c60c009a7f8eb0fe87 WatchSource:0}: Error finding container 321c5f8b8b56fc9eb7060f0dec783c121c55f7389da385c60c009a7f8eb0fe87: Status 404 returned error can't find the container with id 321c5f8b8b56fc9eb7060f0dec783c121c55f7389da385c60c009a7f8eb0fe87 Aug 04 18:00:06.372749 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.372726 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836f56fd_94e7_4229_9744_eddcf05a40fd.slice/crio-9a96cc45211c8a7cdc445ca77e4cbd0647feaa91ce7676447728e241e7aaca0b WatchSource:0}: Error finding container 9a96cc45211c8a7cdc445ca77e4cbd0647feaa91ce7676447728e241e7aaca0b: Status 404 returned error can't find the container with id 9a96cc45211c8a7cdc445ca77e4cbd0647feaa91ce7676447728e241e7aaca0b Aug 04 18:00:06.373941 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.373926 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:06.378298 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.378280 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vn24x" Aug 04 18:00:06.381202 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.381181 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edbbe9e_2d52_43b5_8098_a964b3b88df1.slice/crio-9b1cb715c401bfe5aaa41e103979849d7d9699606c5f0fc3477308513eb9d77f WatchSource:0}: Error finding container 9b1cb715c401bfe5aaa41e103979849d7d9699606c5f0fc3477308513eb9d77f: Status 404 returned error can't find the container with id 9b1cb715c401bfe5aaa41e103979849d7d9699606c5f0fc3477308513eb9d77f Aug 04 18:00:06.385657 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.385638 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c0e506_b7da_4130_acac_c0140c7a8a18.slice/crio-88f8a0165e176e323381b8db25bbef8df240910422252afe82909ec5a1d2ed8f WatchSource:0}: Error finding container 88f8a0165e176e323381b8db25bbef8df240910422252afe82909ec5a1d2ed8f: Status 404 returned error can't find the container with id 88f8a0165e176e323381b8db25bbef8df240910422252afe82909ec5a1d2ed8f Aug 04 18:00:06.396725 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.396708 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" Aug 04 18:00:06.403693 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.403672 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041e0a73_af8a_4e71_9d3d_4a2c2b4a2e44.slice/crio-a712a3ba2f05b5f5f974e6e801ac1ee14a890bb4716bd13b5dc9c9ab230d9e8f WatchSource:0}: Error finding container a712a3ba2f05b5f5f974e6e801ac1ee14a890bb4716bd13b5dc9c9ab230d9e8f: Status 404 returned error can't find the container with id a712a3ba2f05b5f5f974e6e801ac1ee14a890bb4716bd13b5dc9c9ab230d9e8f Aug 04 18:00:06.413511 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.413493 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" Aug 04 18:00:06.420006 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.419984 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1ce6c4_0fce_45c9_af1d_c1c526082161.slice/crio-75ca6905e858376662dd923d1abb0133f2e85857cce44a0d5358553073f115da WatchSource:0}: Error finding container 75ca6905e858376662dd923d1abb0133f2e85857cce44a0d5358553073f115da: Status 404 returned error can't find the container with id 75ca6905e858376662dd923d1abb0133f2e85857cce44a0d5358553073f115da Aug 04 18:00:06.430129 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.430110 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n8zd2" Aug 04 18:00:06.437435 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.437413 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c7dd22_1e03_4b09_a372_2cddfbbafb32.slice/crio-df4bd6b00165186e06f9aaa3090cc5889de065f1a1c09f500f8c8ba910f3c84a WatchSource:0}: Error finding container df4bd6b00165186e06f9aaa3090cc5889de065f1a1c09f500f8c8ba910f3c84a: Status 404 returned error can't find the container with id df4bd6b00165186e06f9aaa3090cc5889de065f1a1c09f500f8c8ba910f3c84a Aug 04 18:00:06.437954 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.437937 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2dmv" Aug 04 18:00:06.445071 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.445049 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f878b7_ee83_4358_b162_228e59040a8b.slice/crio-8f34363120dace2719a8cf6d89055111664c32e591723a1fadb29ffd2406d10b WatchSource:0}: Error finding container 8f34363120dace2719a8cf6d89055111664c32e591723a1fadb29ffd2406d10b: Status 404 returned error can't find the container with id 8f34363120dace2719a8cf6d89055111664c32e591723a1fadb29ffd2406d10b Aug 04 18:00:06.542235 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:06.542204 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82be4bfc3f07367942d8a0fb59c52b4.slice/crio-0e353ddaaebeb5557046ee198dc1a74520bcde97eef2029cc3e80e147eeab149 WatchSource:0}: Error finding container 0e353ddaaebeb5557046ee198dc1a74520bcde97eef2029cc3e80e147eeab149: Status 404 returned error can't find the container with id 0e353ddaaebeb5557046ee198dc1a74520bcde97eef2029cc3e80e147eeab149 Aug 04 18:00:06.633548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.633449 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:06.633703 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.633592 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:06.633703 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.633650 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret podName:ab7a4076-baf9-4296-a630-843220f1341c nodeName:}" failed. No retries permitted until 2026-08-04 18:00:07.633636497 +0000 UTC m=+3.936580401 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret") pod "global-pull-secret-syncer-w8bqx" (UID: "ab7a4076-baf9-4296-a630-843220f1341c") : object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:06.734263 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.734220 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:06.734433 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.734399 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:06.734482 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.734471 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs podName:349d54df-5bd2-4a3f-8d94-25c6ec118a46 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:07.734451118 +0000 UTC m=+4.037395023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs") pod "network-metrics-daemon-5brj6" (UID: "349d54df-5bd2-4a3f-8d94-25c6ec118a46") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:06.835236 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:06.835198 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:06.835387 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.835328 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 18:00:06.835387 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.835345 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 18:00:06.835387 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.835355 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9cf89 for pod openshift-network-diagnostics/network-check-target-q7ttb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:06.835501 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:06.835405 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89 podName:ae52f154-23ed-4d15-adf7-84bc6f4e80e0 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:07.83539218 +0000 UTC m=+4.138336084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cf89" (UniqueName: "kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89") pod "network-check-target-q7ttb" (UID: "ae52f154-23ed-4d15-adf7-84bc6f4e80e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:07.124401 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.123954 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:55:06 +0000 UTC" deadline="2028-03-06 12:13:50.670017691 +0000 UTC" Aug 04 18:00:07.124401 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.123995 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13914h13m43.546027962s" Aug 04 18:00:07.161017 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.160940 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vn24x" event={"ID":"27c0e506-b7da-4130-acac-c0140c7a8a18","Type":"ContainerStarted","Data":"88f8a0165e176e323381b8db25bbef8df240910422252afe82909ec5a1d2ed8f"} Aug 04 18:00:07.162248 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.162219 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" event={"ID":"836f56fd-94e7-4229-9744-eddcf05a40fd","Type":"ContainerStarted","Data":"9a96cc45211c8a7cdc445ca77e4cbd0647feaa91ce7676447728e241e7aaca0b"} Aug 04 18:00:07.163383 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.163355 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8bjfh" event={"ID":"d8db9569-f0a2-47f8-a876-839d7dcbfdab","Type":"ContainerStarted","Data":"321c5f8b8b56fc9eb7060f0dec783c121c55f7389da385c60c009a7f8eb0fe87"} Aug 04 18:00:07.164429 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.164401 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qprpr" event={"ID":"a5d518ae-f261-4144-9854-a18ba566698e","Type":"ContainerStarted","Data":"26a141941596546cdb8716611bc7e599027b4a12ad07fceb0716d620874c00f1"} Aug 04 18:00:07.165590 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.165563 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" event={"ID":"f69fc9e0b3bb68d48b82a7e4d504e25f","Type":"ContainerStarted","Data":"28bfadf93dcd3a8cf13fd16463d39b24c3d0ab897b721d06449deacc9a8bf0c8"} Aug 04 18:00:07.166626 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.166601 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal" event={"ID":"c82be4bfc3f07367942d8a0fb59c52b4","Type":"ContainerStarted","Data":"0e353ddaaebeb5557046ee198dc1a74520bcde97eef2029cc3e80e147eeab149"} Aug 04 18:00:07.167751 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.167714 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" event={"ID":"de1ce6c4-0fce-45c9-af1d-c1c526082161","Type":"ContainerStarted","Data":"75ca6905e858376662dd923d1abb0133f2e85857cce44a0d5358553073f115da"} Aug 04 18:00:07.168868 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.168849 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" event={"ID":"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44","Type":"ContainerStarted","Data":"a712a3ba2f05b5f5f974e6e801ac1ee14a890bb4716bd13b5dc9c9ab230d9e8f"} Aug 04 18:00:07.170072 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.170048 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" event={"ID":"8edbbe9e-2d52-43b5-8098-a964b3b88df1","Type":"ContainerStarted","Data":"9b1cb715c401bfe5aaa41e103979849d7d9699606c5f0fc3477308513eb9d77f"} Aug 04 18:00:07.171173 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.171150 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2dmv" event={"ID":"20f878b7-ee83-4358-b162-228e59040a8b","Type":"ContainerStarted","Data":"8f34363120dace2719a8cf6d89055111664c32e591723a1fadb29ffd2406d10b"} Aug 04 18:00:07.172245 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.172224 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n8zd2" event={"ID":"83c7dd22-1e03-4b09-a372-2cddfbbafb32","Type":"ContainerStarted","Data":"df4bd6b00165186e06f9aaa3090cc5889de065f1a1c09f500f8c8ba910f3c84a"} Aug 04 18:00:07.640467 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.640425 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:07.640686 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:07.640618 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:07.640746 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:07.640691 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret podName:ab7a4076-baf9-4296-a630-843220f1341c nodeName:}" failed. No retries permitted until 2026-08-04 18:00:09.640670911 +0000 UTC m=+5.943614820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret") pod "global-pull-secret-syncer-w8bqx" (UID: "ab7a4076-baf9-4296-a630-843220f1341c") : object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:07.741531 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.741478 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:07.741731 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:07.741704 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:07.741787 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:07.741771 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs podName:349d54df-5bd2-4a3f-8d94-25c6ec118a46 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:09.741751443 +0000 UTC m=+6.044695353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs") pod "network-metrics-daemon-5brj6" (UID: "349d54df-5bd2-4a3f-8d94-25c6ec118a46") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:07.842384 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:07.842346 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:07.842523 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:07.842486 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 18:00:07.842523 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:07.842504 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 18:00:07.842667 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:07.842526 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9cf89 for pod openshift-network-diagnostics/network-check-target-q7ttb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:07.842667 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:07.842587 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89 podName:ae52f154-23ed-4d15-adf7-84bc6f4e80e0 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:09.842573114 +0000 UTC m=+6.145517022 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cf89" (UniqueName: "kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89") pod "network-check-target-q7ttb" (UID: "ae52f154-23ed-4d15-adf7-84bc6f4e80e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:08.124799 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:08.124725 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 17:55:06 +0000 UTC" deadline="2028-03-14 19:30:13.410554925 +0000 UTC" Aug 04 18:00:08.124799 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:08.124797 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14113h30m5.285762768s" Aug 04 18:00:08.154252 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:08.154218 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:08.154428 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:08.154364 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:08.154796 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:08.154776 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:08.154902 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:08.154883 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:08.154966 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:08.154952 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:08.155054 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:08.155035 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:09.199790 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:09.199516 2583 generic.go:356] "Generic (PLEG): container finished" podID="f69fc9e0b3bb68d48b82a7e4d504e25f" containerID="6e13dbeb5cbfa5e0c90376f8798a2b95585720892e872ab1707249fe59272f14" exitCode=0 Aug 04 18:00:09.200200 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:09.199812 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" event={"ID":"f69fc9e0b3bb68d48b82a7e4d504e25f","Type":"ContainerDied","Data":"6e13dbeb5cbfa5e0c90376f8798a2b95585720892e872ab1707249fe59272f14"} Aug 04 18:00:09.657401 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:09.657359 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:09.657611 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:09.657570 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:09.657687 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:09.657638 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret podName:ab7a4076-baf9-4296-a630-843220f1341c nodeName:}" failed. No retries permitted until 2026-08-04 18:00:13.657619886 +0000 UTC m=+9.960563806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret") pod "global-pull-secret-syncer-w8bqx" (UID: "ab7a4076-baf9-4296-a630-843220f1341c") : object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:09.758954 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:09.758245 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:09.758954 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:09.758457 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:09.758954 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:09.758527 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs podName:349d54df-5bd2-4a3f-8d94-25c6ec118a46 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:13.75850487 +0000 UTC m=+10.061448775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs") pod "network-metrics-daemon-5brj6" (UID: "349d54df-5bd2-4a3f-8d94-25c6ec118a46") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:09.860101 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:09.859418 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:09.860101 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:09.859620 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 18:00:09.860101 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:09.859642 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 18:00:09.860101 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:09.859657 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9cf89 for pod openshift-network-diagnostics/network-check-target-q7ttb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:09.860101 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:09.859717 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89 podName:ae52f154-23ed-4d15-adf7-84bc6f4e80e0 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:13.859697014 +0000 UTC m=+10.162640934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cf89" (UniqueName: "kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89") pod "network-check-target-q7ttb" (UID: "ae52f154-23ed-4d15-adf7-84bc6f4e80e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:10.150743 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:10.150654 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:10.150743 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:10.150693 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:10.150961 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:10.150817 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:10.150961 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:10.150853 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:10.151064 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:10.150970 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:10.151125 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:10.151076 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:10.235997 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:10.235795 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" event={"ID":"f69fc9e0b3bb68d48b82a7e4d504e25f","Type":"ContainerStarted","Data":"017e3691fc1a11ad9aa77a0ef7d26ccf1c64a25a7b4cab325a0aebb8751788df"} Aug 04 18:00:10.255231 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:10.254465 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-51.ec2.internal" podStartSLOduration=4.254442091 podStartE2EDuration="4.254442091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:10.25412161 +0000 UTC m=+6.557065540" watchObservedRunningTime="2026-08-04 18:00:10.254442091 +0000 UTC m=+6.557386022" Aug 04 18:00:12.153806 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:12.152894 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:12.153806 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:12.153038 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:12.153806 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:12.153480 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:12.153806 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:12.153588 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:12.153806 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:12.153664 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:12.153806 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:12.153748 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:13.695183 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:13.695137 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:13.695691 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:13.695307 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:13.695691 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:13.695401 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret podName:ab7a4076-baf9-4296-a630-843220f1341c nodeName:}" failed. No retries permitted until 2026-08-04 18:00:21.695377735 +0000 UTC m=+17.998321654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret") pod "global-pull-secret-syncer-w8bqx" (UID: "ab7a4076-baf9-4296-a630-843220f1341c") : object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:13.796169 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:13.795541 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:13.796169 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:13.795744 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:13.796169 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:13.795814 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs podName:349d54df-5bd2-4a3f-8d94-25c6ec118a46 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:21.795794162 +0000 UTC m=+18.098738068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs") pod "network-metrics-daemon-5brj6" (UID: "349d54df-5bd2-4a3f-8d94-25c6ec118a46") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:13.897383 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:13.897338 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:13.898088 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:13.897606 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 18:00:13.898088 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:13.897631 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 18:00:13.898088 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:13.897644 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9cf89 for pod openshift-network-diagnostics/network-check-target-q7ttb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:13.898088 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:13.897706 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89 podName:ae52f154-23ed-4d15-adf7-84bc6f4e80e0 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:21.897688837 +0000 UTC m=+18.200632762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cf89" (UniqueName: "kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89") pod "network-check-target-q7ttb" (UID: "ae52f154-23ed-4d15-adf7-84bc6f4e80e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:14.152168 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:14.151743 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:14.152168 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:14.151796 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:14.152168 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:14.151905 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:14.152168 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:14.151938 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:14.152168 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:14.151987 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:14.152168 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:14.152068 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:16.150569 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:16.150529 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:16.151047 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:16.150578 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:16.151047 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:16.150681 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:16.151047 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:16.150767 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:16.151047 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:16.150820 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:16.151047 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:16.150901 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:18.150114 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:18.150081 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:18.150535 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:18.150089 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:18.150535 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:18.150179 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:18.150535 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:18.150236 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:18.150535 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:18.150258 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:18.150535 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:18.150337 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:20.150598 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:20.150567 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:20.151066 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:20.150606 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:20.151066 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:20.150575 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:20.151066 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:20.150679 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:20.151066 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:20.150781 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:20.151066 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:20.150824 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:21.756430 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:21.756392 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:21.756927 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:21.756529 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:21.756927 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:21.756591 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret podName:ab7a4076-baf9-4296-a630-843220f1341c nodeName:}" failed. No retries permitted until 2026-08-04 18:00:37.756574937 +0000 UTC m=+34.059518840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret") pod "global-pull-secret-syncer-w8bqx" (UID: "ab7a4076-baf9-4296-a630-843220f1341c") : object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:21.856762 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:21.856723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:21.856921 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:21.856859 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:21.856921 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:21.856913 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs podName:349d54df-5bd2-4a3f-8d94-25c6ec118a46 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:37.856898668 +0000 UTC m=+34.159842571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs") pod "network-metrics-daemon-5brj6" (UID: "349d54df-5bd2-4a3f-8d94-25c6ec118a46") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:21.957548 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:21.957492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:21.957720 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:21.957651 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 18:00:21.957720 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:21.957679 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 18:00:21.957720 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:21.957692 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9cf89 for pod openshift-network-diagnostics/network-check-target-q7ttb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:21.957854 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:21.957744 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89 podName:ae52f154-23ed-4d15-adf7-84bc6f4e80e0 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:37.957731239 +0000 UTC m=+34.260675146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cf89" (UniqueName: "kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89") pod "network-check-target-q7ttb" (UID: "ae52f154-23ed-4d15-adf7-84bc6f4e80e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:22.150183 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:22.150098 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:22.150183 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:22.150138 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:22.150183 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:22.150098 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:22.150564 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:22.150241 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:22.150564 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:22.150393 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:22.150564 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:22.150480 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:24.151099 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:24.151062 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:24.151608 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:24.151167 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:24.151608 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:24.151266 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:24.151608 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:24.151385 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:24.151608 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:24.151412 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:24.151608 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:24.151488 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:26.150354 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:26.150318 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:26.150840 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:26.150322 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:26.150840 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:26.150448 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:26.150840 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:26.150322 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:26.150840 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:26.150551 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:26.150840 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:26.150621 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:27.270493 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.270127 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qprpr" event={"ID":"a5d518ae-f261-4144-9854-a18ba566698e","Type":"ContainerStarted","Data":"a75bdc8635043b94b80e91a7801b5c566615cc366e8217a335c50a048929d4d6"} Aug 04 18:00:27.271442 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.271418 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal" event={"ID":"c82be4bfc3f07367942d8a0fb59c52b4","Type":"ContainerStarted","Data":"8047f6f8c564e1d715dd2c357935fa2017b021c3dcdbdf9d7e9a5efe11b12cee"} Aug 04 18:00:27.272576 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.272555 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" event={"ID":"de1ce6c4-0fce-45c9-af1d-c1c526082161","Type":"ContainerStarted","Data":"43f76858a45f3570cba4b473797d0e1305466ebe742208daee9adf8536ddbb3d"} Aug 04 18:00:27.273752 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.273733 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" event={"ID":"041e0a73-af8a-4e71-9d3d-4a2c2b4a2e44","Type":"ContainerStarted","Data":"a2e461003f760c0e83a16ca4c418eb74c97fadfd8b80376c74cec26030d5b768"} Aug 04 18:00:27.276090 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.276071 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" event={"ID":"8edbbe9e-2d52-43b5-8098-a964b3b88df1","Type":"ContainerStarted","Data":"33cc4c060294752a52a967b44b5cbc7b9ce0643e17ebc6f5796300fc90b6920c"} Aug 04 18:00:27.276155 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.276127 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" event={"ID":"8edbbe9e-2d52-43b5-8098-a964b3b88df1","Type":"ContainerStarted","Data":"53b1a9a70d1efe6a55ea8bf23f465d01bbf77baa4915cb4e2de018c8fae50ca2"} Aug 04 18:00:27.276208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.276164 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" event={"ID":"8edbbe9e-2d52-43b5-8098-a964b3b88df1","Type":"ContainerStarted","Data":"f4a8c77a387890eedf2d6824207931ed8de23d22f1784e155be8a6bc873e3a9d"} Aug 04 18:00:27.276208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.276201 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" event={"ID":"8edbbe9e-2d52-43b5-8098-a964b3b88df1","Type":"ContainerStarted","Data":"2a6f566efac08e9fa246ab00be44f89b52d1ef074035014b32f5bcf9f2ef91be"} Aug 04 18:00:27.276286 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.276232 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" event={"ID":"8edbbe9e-2d52-43b5-8098-a964b3b88df1","Type":"ContainerStarted","Data":"5e416d27a586067fb921a39f40e2666953b53217f2d9e3090b7d1799a7ade6c2"} Aug 04 18:00:27.277211 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.277194 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n8zd2" event={"ID":"83c7dd22-1e03-4b09-a372-2cddfbbafb32","Type":"ContainerStarted","Data":"2094ae3dcc314644d0df9caa377ff5febc5c853a8009b5bd7e84804b599488f5"} Aug 04 18:00:27.278350 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.278331 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vn24x" event={"ID":"27c0e506-b7da-4130-acac-c0140c7a8a18","Type":"ContainerStarted","Data":"1acddc070000e36388ba7f0e787c65f61ed3e14326306bcb07c548a7ef7d4ed7"} Aug 04 18:00:27.279586 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.279565 2583 generic.go:356] "Generic (PLEG): container finished" podID="836f56fd-94e7-4229-9744-eddcf05a40fd" containerID="5ee10abc55b4e9208a3fcfa7d0ddc87366a0dd5fab03ed73cc4422f851c181ca" exitCode=0 Aug 04 18:00:27.279671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.279620 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" event={"ID":"836f56fd-94e7-4229-9744-eddcf05a40fd","Type":"ContainerDied","Data":"5ee10abc55b4e9208a3fcfa7d0ddc87366a0dd5fab03ed73cc4422f851c181ca"} Aug 04 18:00:27.281151 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.281133 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8bjfh" event={"ID":"d8db9569-f0a2-47f8-a876-839d7dcbfdab","Type":"ContainerStarted","Data":"f9048a48fcc6d3e7ed366d2979663fcb00d077dcf5919d7990529f8d0093d529"} Aug 04 18:00:27.288602 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.288566 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qprpr" podStartSLOduration=1.989160314 podStartE2EDuration="22.288537837s" totalImagesPullingTime="20.299377523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:27.287827932 +0000 UTC m=+23.590771857" watchObservedRunningTime="2026-08-04 18:00:27.288537837 +0000 UTC m=+23.591481761" Aug 04 18:00:27.325989 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.325931 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vn24x" podStartSLOduration=2.060413565 podStartE2EDuration="22.325911478s" totalImagesPullingTime="20.265497913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:27.325137983 +0000 UTC m=+23.628081909" watchObservedRunningTime="2026-08-04 18:00:27.325911478 +0000 UTC m=+23.628855404" Aug 04 18:00:27.340310 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.340256 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n8zd2" podStartSLOduration=2.133031368 podStartE2EDuration="22.340241444s" totalImagesPullingTime="20.207210076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:27.339919607 +0000 UTC m=+23.642863531" watchObservedRunningTime="2026-08-04 18:00:27.340241444 +0000 UTC m=+23.643185369" Aug 04 18:00:27.365376 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.365324 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-51.ec2.internal" podStartSLOduration=21.365303747 podStartE2EDuration="21.365303747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:27.364780383 +0000 UTC m=+23.667724306" watchObservedRunningTime="2026-08-04 18:00:27.365303747 +0000 UTC m=+23.668247673" Aug 04 18:00:27.417106 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.417010 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8bjfh" podStartSLOduration=2.083096989 podStartE2EDuration="22.416996513s" totalImagesPullingTime="20.333899524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:27.416664558 +0000 UTC m=+23.719608483" watchObservedRunningTime="2026-08-04 18:00:27.416996513 +0000 UTC m=+23.719940716" Aug 04 18:00:27.435803 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:27.435758 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mc2gz" podStartSLOduration=2.194982695 podStartE2EDuration="22.435742351s" totalImagesPullingTime="20.240759656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:27.435073809 +0000 UTC m=+23.738017734" watchObservedRunningTime="2026-08-04 18:00:27.435742351 +0000 UTC m=+23.738686275" Aug 04 18:00:28.042236 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.042210 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:28.042860 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.042841 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:28.149849 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.149825 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:28.150021 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:28.149943 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:28.150344 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.150327 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:28.150431 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:28.150409 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:28.150519 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.150490 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:28.150624 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:28.150603 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:28.159340 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.159318 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 04 18:00:28.284851 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.284741 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2dmv" event={"ID":"20f878b7-ee83-4358-b162-228e59040a8b","Type":"ContainerStarted","Data":"1f80ac0199428b7b744dad5303229b325396fe8bac14f32dc1a5dc296895122b"} Aug 04 18:00:28.286717 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.286662 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" event={"ID":"de1ce6c4-0fce-45c9-af1d-c1c526082161","Type":"ContainerStarted","Data":"825fa86cdb6fbbc88f8aaf48529af7a5e5f65a6a63015b00f9bfe1e94636790f"} Aug 04 18:00:28.289856 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.289745 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" event={"ID":"8edbbe9e-2d52-43b5-8098-a964b3b88df1","Type":"ContainerStarted","Data":"085f80095e3d971714099edc2ae7fe0a51ddc97780f2b424234a9fb64636b642"} Aug 04 18:00:28.290551 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.290531 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:28.290940 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.290921 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qprpr" Aug 04 18:00:28.302984 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:28.302950 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n2dmv" podStartSLOduration=3.100472366 podStartE2EDuration="23.302935644s" totalImagesPullingTime="20.202463278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:28.302561712 +0000 UTC m=+24.605505636" watchObservedRunningTime="2026-08-04 18:00:28.302935644 +0000 UTC m=+24.605879569" Aug 04 18:00:29.089623 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:29.089535 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T18:00:28.159336086Z","UUID":"570c36c9-512c-432d-a6f9-54164a37c8a4","Handler":null,"Name":"","Endpoint":""} Aug 04 18:00:29.092692 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:29.092667 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 04 18:00:29.092833 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:29.092709 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 04 18:00:29.294383 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:29.294335 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" event={"ID":"de1ce6c4-0fce-45c9-af1d-c1c526082161","Type":"ContainerStarted","Data":"3919860edbefe529cd754b4cc04c1e204818badeda9d26dbafae26079a7d4070"} Aug 04 18:00:29.312870 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:29.312819 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xv7gw" podStartSLOduration=1.972876013 podStartE2EDuration="24.312803281s" totalImagesPullingTime="22.339927268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:29.312611118 +0000 UTC m=+25.615555044" watchObservedRunningTime="2026-08-04 18:00:29.312803281 +0000 UTC m=+25.615747205" Aug 04 18:00:30.150885 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:30.150693 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:30.151160 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:30.150692 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:30.151160 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:30.150747 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:30.151160 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:30.150983 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:30.151160 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:30.151086 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:30.151365 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:30.151154 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:30.300214 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:30.300180 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" event={"ID":"8edbbe9e-2d52-43b5-8098-a964b3b88df1","Type":"ContainerStarted","Data":"2436fe4ed3fe32e9dd733ed970d282a11a34e5a1d7af2119e7ed81ab0888abfd"} Aug 04 18:00:32.150337 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.150170 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:32.151147 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.150233 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:32.151147 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:32.150407 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:32.151147 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.150170 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:32.151147 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:32.150465 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:32.151147 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:32.150530 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:32.306232 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.306197 2583 generic.go:356] "Generic (PLEG): container finished" podID="836f56fd-94e7-4229-9744-eddcf05a40fd" containerID="83653e768d1bcb834ee144c0f433f92545592b2d9b64a9cd4131e43934fb5906" exitCode=0 Aug 04 18:00:32.306388 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.306286 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" event={"ID":"836f56fd-94e7-4229-9744-eddcf05a40fd","Type":"ContainerDied","Data":"83653e768d1bcb834ee144c0f433f92545592b2d9b64a9cd4131e43934fb5906"} Aug 04 18:00:32.310054 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.310027 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" event={"ID":"8edbbe9e-2d52-43b5-8098-a964b3b88df1","Type":"ContainerStarted","Data":"1902f6499634880c0a2b76ac442fddb3d85a469e644351f1e3e30d19041fb507"} Aug 04 18:00:32.310298 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.310281 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:32.310366 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.310338 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:32.310414 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.310386 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:32.325187 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.325169 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:32.328920 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.328902 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:00:32.352765 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:32.352716 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" podStartSLOduration=7.007802869 podStartE2EDuration="27.35270165s" totalImagesPullingTime="20.344898781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:32.352187178 +0000 UTC m=+28.655131103" watchObservedRunningTime="2026-08-04 18:00:32.35270165 +0000 UTC m=+28.655645614" Aug 04 18:00:33.573902 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:33.573870 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w8bqx"] Aug 04 18:00:33.574350 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:33.573975 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:33.574350 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:33.574084 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:33.580442 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:33.578067 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q7ttb"] Aug 04 18:00:33.580442 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:33.578315 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:33.580442 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:33.578488 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:33.580442 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:33.578986 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5brj6"] Aug 04 18:00:33.580442 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:33.579134 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:33.580442 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:33.579320 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:34.316003 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:34.315793 2583 generic.go:356] "Generic (PLEG): container finished" podID="836f56fd-94e7-4229-9744-eddcf05a40fd" containerID="e11af489240b91d5ed8c174b318d1e85ec108007a0dedb2849a68893e60b5af6" exitCode=0 Aug 04 18:00:34.316003 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:34.315870 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" event={"ID":"836f56fd-94e7-4229-9744-eddcf05a40fd","Type":"ContainerDied","Data":"e11af489240b91d5ed8c174b318d1e85ec108007a0dedb2849a68893e60b5af6"} Aug 04 18:00:35.149908 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:35.149873 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:35.149908 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:35.149911 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:35.150332 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:35.149986 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:35.150332 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:35.150010 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:35.150332 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:35.150048 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:35.150332 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:35.150115 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:37.150083 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:37.150053 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:37.150662 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:37.150056 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:37.150662 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:37.150189 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:37.150662 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.150150 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:37.150662 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.150259 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:37.150662 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.150318 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:37.324556 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:37.324521 2583 generic.go:356] "Generic (PLEG): container finished" podID="836f56fd-94e7-4229-9744-eddcf05a40fd" containerID="a9287b1d917bb0769b289f4d3c136d3c937ede98e5bf92a7810dfb560629a87f" exitCode=0 Aug 04 18:00:37.324556 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:37.324560 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" event={"ID":"836f56fd-94e7-4229-9744-eddcf05a40fd","Type":"ContainerDied","Data":"a9287b1d917bb0769b289f4d3c136d3c937ede98e5bf92a7810dfb560629a87f"} Aug 04 18:00:37.777547 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:37.777435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:37.777695 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.777622 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:37.777749 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.777698 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret podName:ab7a4076-baf9-4296-a630-843220f1341c nodeName:}" failed. No retries permitted until 2026-08-04 18:01:09.777681623 +0000 UTC m=+66.080625529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret") pod "global-pull-secret-syncer-w8bqx" (UID: "ab7a4076-baf9-4296-a630-843220f1341c") : object "kube-system"/"original-pull-secret" not registered Aug 04 18:00:37.878807 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:37.878772 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:37.878993 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.878940 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:37.879058 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.879012 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs podName:349d54df-5bd2-4a3f-8d94-25c6ec118a46 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:09.878992084 +0000 UTC m=+66.181935987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs") pod "network-metrics-daemon-5brj6" (UID: "349d54df-5bd2-4a3f-8d94-25c6ec118a46") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 04 18:00:37.979365 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:37.979327 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:37.979566 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.979485 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 04 18:00:37.979566 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.979522 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 04 18:00:37.979566 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.979535 2583 projected.go:196] Error preparing data for projected volume kube-api-access-9cf89 for pod openshift-network-diagnostics/network-check-target-q7ttb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:37.979699 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:37.979598 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89 podName:ae52f154-23ed-4d15-adf7-84bc6f4e80e0 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:09.979580689 +0000 UTC m=+66.282524599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cf89" (UniqueName: "kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89") pod "network-check-target-q7ttb" (UID: "ae52f154-23ed-4d15-adf7-84bc6f4e80e0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 04 18:00:39.150114 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.150085 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:39.150728 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.150122 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:39.150728 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.150134 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:39.150728 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:39.150392 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5brj6" podUID="349d54df-5bd2-4a3f-8d94-25c6ec118a46" Aug 04 18:00:39.150728 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:39.150481 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8bqx" podUID="ab7a4076-baf9-4296-a630-843220f1341c" Aug 04 18:00:39.150728 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:39.150566 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q7ttb" podUID="ae52f154-23ed-4d15-adf7-84bc6f4e80e0" Aug 04 18:00:39.528127 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.528050 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-51.ec2.internal" event="NodeReady" Aug 04 18:00:39.528274 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.528205 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 04 18:00:39.585725 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.585687 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-42kq7"] Aug 04 18:00:39.588080 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.588058 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6s7g8"] Aug 04 18:00:39.588197 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.588173 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.590023 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.590006 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6s7g8" Aug 04 18:00:39.592862 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.592846 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 04 18:00:39.593195 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.593177 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 04 18:00:39.593638 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.593471 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 04 18:00:39.593638 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.593514 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2cqb\"" Aug 04 18:00:39.593803 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.593710 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 04 18:00:39.593803 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.593778 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 04 18:00:39.594026 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.594011 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rzh2g\"" Aug 04 18:00:39.600875 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.600858 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-42kq7"] Aug 04 18:00:39.614623 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.614599 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6s7g8"] Aug 04 18:00:39.690990 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.690960 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.690990 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.690995 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9zpk\" (UniqueName: \"kubernetes.io/projected/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-kube-api-access-z9zpk\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.691221 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.691043 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/940a334e-5559-4412-b378-6c59a51da197-cert\") pod \"ingress-canary-6s7g8\" (UID: \"940a334e-5559-4412-b378-6c59a51da197\") " pod="openshift-ingress-canary/ingress-canary-6s7g8" Aug 04 18:00:39.691221 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.691132 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwhb5\" (UniqueName: \"kubernetes.io/projected/940a334e-5559-4412-b378-6c59a51da197-kube-api-access-wwhb5\") pod \"ingress-canary-6s7g8\" (UID: \"940a334e-5559-4412-b378-6c59a51da197\") " pod="openshift-ingress-canary/ingress-canary-6s7g8" Aug 04 18:00:39.691221 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.691186 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-config-volume\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.691346 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.691239 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-tmp-dir\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.792406 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.792316 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-config-volume\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.792406 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.792385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-tmp-dir\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.792713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.792423 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.792713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.792443 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9zpk\" (UniqueName: \"kubernetes.io/projected/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-kube-api-access-z9zpk\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.792713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.792497 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/940a334e-5559-4412-b378-6c59a51da197-cert\") pod \"ingress-canary-6s7g8\" (UID: \"940a334e-5559-4412-b378-6c59a51da197\") " pod="openshift-ingress-canary/ingress-canary-6s7g8" Aug 04 18:00:39.792713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.792553 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwhb5\" (UniqueName: \"kubernetes.io/projected/940a334e-5559-4412-b378-6c59a51da197-kube-api-access-wwhb5\") pod \"ingress-canary-6s7g8\" (UID: \"940a334e-5559-4412-b378-6c59a51da197\") " pod="openshift-ingress-canary/ingress-canary-6s7g8" Aug 04 18:00:39.792713 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:39.792589 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 18:00:39.792713 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:39.792663 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls podName:d539a6c0-c527-43c8-b9b2-ae8137a4e7a8 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:40.292642829 +0000 UTC m=+36.595586736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls") pod "dns-default-42kq7" (UID: "d539a6c0-c527-43c8-b9b2-ae8137a4e7a8") : secret "dns-default-metrics-tls" not found Aug 04 18:00:39.793023 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.792999 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-config-volume\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.793190 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.793162 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-tmp-dir\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.797249 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.797224 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/940a334e-5559-4412-b378-6c59a51da197-cert\") pod \"ingress-canary-6s7g8\" (UID: \"940a334e-5559-4412-b378-6c59a51da197\") " pod="openshift-ingress-canary/ingress-canary-6s7g8" Aug 04 18:00:39.803226 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.803202 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9zpk\" (UniqueName: \"kubernetes.io/projected/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-kube-api-access-z9zpk\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:39.803522 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.803479 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwhb5\" (UniqueName: \"kubernetes.io/projected/940a334e-5559-4412-b378-6c59a51da197-kube-api-access-wwhb5\") pod \"ingress-canary-6s7g8\" (UID: \"940a334e-5559-4412-b378-6c59a51da197\") " pod="openshift-ingress-canary/ingress-canary-6s7g8" Aug 04 18:00:39.904755 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:39.904722 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6s7g8" Aug 04 18:00:40.296020 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:40.295987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:40.296480 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:40.296160 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 18:00:40.296480 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:40.296231 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls podName:d539a6c0-c527-43c8-b9b2-ae8137a4e7a8 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:41.29621619 +0000 UTC m=+37.599160093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls") pod "dns-default-42kq7" (UID: "d539a6c0-c527-43c8-b9b2-ae8137a4e7a8") : secret "dns-default-metrics-tls" not found Aug 04 18:00:41.133960 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.133932 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6s7g8"] Aug 04 18:00:41.138156 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:00:41.138122 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940a334e_5559_4412_b378_6c59a51da197.slice/crio-e451bd289db35db522211ba2355603b6b639aa61463c35fb008e8f54d60ab767 WatchSource:0}: Error finding container e451bd289db35db522211ba2355603b6b639aa61463c35fb008e8f54d60ab767: Status 404 returned error can't find the container with id e451bd289db35db522211ba2355603b6b639aa61463c35fb008e8f54d60ab767 Aug 04 18:00:41.150241 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.150220 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:00:41.150333 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.150220 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:00:41.150438 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.150220 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:00:41.152672 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.152646 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nfg9c\"" Aug 04 18:00:41.152787 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.152708 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 04 18:00:41.152787 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.152730 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 04 18:00:41.152787 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.152767 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hp4qc\"" Aug 04 18:00:41.152787 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.152784 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 04 18:00:41.152999 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.152732 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 04 18:00:41.305008 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.304903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:41.305400 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:41.305063 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 18:00:41.305400 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:41.305138 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls podName:d539a6c0-c527-43c8-b9b2-ae8137a4e7a8 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:43.305122237 +0000 UTC m=+39.608066144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls") pod "dns-default-42kq7" (UID: "d539a6c0-c527-43c8-b9b2-ae8137a4e7a8") : secret "dns-default-metrics-tls" not found Aug 04 18:00:41.338053 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.338027 2583 generic.go:356] "Generic (PLEG): container finished" podID="836f56fd-94e7-4229-9744-eddcf05a40fd" containerID="eff780df271925db47752e9c7bc95bba8a31c402fc0140116eb74a94aa15040d" exitCode=0 Aug 04 18:00:41.338203 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.338111 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" event={"ID":"836f56fd-94e7-4229-9744-eddcf05a40fd","Type":"ContainerDied","Data":"eff780df271925db47752e9c7bc95bba8a31c402fc0140116eb74a94aa15040d"} Aug 04 18:00:41.339155 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:41.339136 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6s7g8" event={"ID":"940a334e-5559-4412-b378-6c59a51da197","Type":"ContainerStarted","Data":"e451bd289db35db522211ba2355603b6b639aa61463c35fb008e8f54d60ab767"} Aug 04 18:00:42.345244 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:42.345204 2583 generic.go:356] "Generic (PLEG): container finished" podID="836f56fd-94e7-4229-9744-eddcf05a40fd" containerID="467f013e426d71336fb88fdc56b90e7f8a881486c66bca02611a1b84feb72ce2" exitCode=0 Aug 04 18:00:42.345713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:42.345292 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" event={"ID":"836f56fd-94e7-4229-9744-eddcf05a40fd","Type":"ContainerDied","Data":"467f013e426d71336fb88fdc56b90e7f8a881486c66bca02611a1b84feb72ce2"} Aug 04 18:00:43.322407 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:43.322240 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:43.322407 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:43.322395 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 18:00:43.322605 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:43.322460 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls podName:d539a6c0-c527-43c8-b9b2-ae8137a4e7a8 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:47.322444528 +0000 UTC m=+43.625388431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls") pod "dns-default-42kq7" (UID: "d539a6c0-c527-43c8-b9b2-ae8137a4e7a8") : secret "dns-default-metrics-tls" not found Aug 04 18:00:43.350122 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:43.350095 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" event={"ID":"836f56fd-94e7-4229-9744-eddcf05a40fd","Type":"ContainerStarted","Data":"72c3268da124165ad2a1158902593e28ea5ea17d4c3a126290041f7222d6316f"} Aug 04 18:00:43.373402 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:43.373361 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8nwkj" podStartSLOduration=6.555242686 podStartE2EDuration="38.373345938s" totalImagesPullingTime="31.818103252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:43.37208602 +0000 UTC m=+39.675029945" watchObservedRunningTime="2026-08-04 18:00:43.373345938 +0000 UTC m=+39.676289863" Aug 04 18:00:44.353488 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:44.353444 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6s7g8" event={"ID":"940a334e-5559-4412-b378-6c59a51da197","Type":"ContainerStarted","Data":"f32318be62653cdf97ef1dc93cc8cc039ec8635d865fe8c2a0790ba8dab0bd32"} Aug 04 18:00:44.377301 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:44.377255 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6s7g8" podStartSLOduration=3.150743532 podStartE2EDuration="5.377240358s" totalImagesPullingTime="2.226496826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:00:44.376491296 +0000 UTC m=+40.679435222" watchObservedRunningTime="2026-08-04 18:00:44.377240358 +0000 UTC m=+40.680184283" Aug 04 18:00:47.349686 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:47.349643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:47.350065 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:47.349766 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 18:00:47.350065 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:47.349822 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls podName:d539a6c0-c527-43c8-b9b2-ae8137a4e7a8 nodeName:}" failed. No retries permitted until 2026-08-04 18:00:55.349806422 +0000 UTC m=+51.652750343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls") pod "dns-default-42kq7" (UID: "d539a6c0-c527-43c8-b9b2-ae8137a4e7a8") : secret "dns-default-metrics-tls" not found Aug 04 18:00:55.402349 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:00:55.402317 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:00:55.402777 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:55.402422 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 18:00:55.402777 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:00:55.402471 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls podName:d539a6c0-c527-43c8-b9b2-ae8137a4e7a8 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:11.402456939 +0000 UTC m=+67.705400842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls") pod "dns-default-42kq7" (UID: "d539a6c0-c527-43c8-b9b2-ae8137a4e7a8") : secret "dns-default-metrics-tls" not found Aug 04 18:01:04.325719 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:04.325693 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dwhtp" Aug 04 18:01:09.799900 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.799849 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:01:09.802826 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.802807 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 04 18:01:09.814130 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.814100 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ab7a4076-baf9-4296-a630-843220f1341c-original-pull-secret\") pod \"global-pull-secret-syncer-w8bqx\" (UID: \"ab7a4076-baf9-4296-a630-843220f1341c\") " pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:01:09.891448 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.891413 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cd9c7fccf-j94rd"] Aug 04 18:01:09.894142 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.894126 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56"] Aug 04 18:01:09.894259 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.894241 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:09.895800 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.895776 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m"] Aug 04 18:01:09.895922 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.895889 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:09.896598 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.896578 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 04 18:01:09.897440 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.897420 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:09.900552 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.900532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:01:09.901674 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.901659 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 04 18:01:09.909466 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.909449 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 04 18:01:09.909676 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.909664 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5b4qm\"" Aug 04 18:01:09.921659 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.921631 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 04 18:01:09.937456 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.937427 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Aug 04 18:01:09.939740 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.939721 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 04 18:01:09.939844 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.939805 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Aug 04 18:01:09.940081 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.940063 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 04 18:01:09.940327 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.940304 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 04 18:01:09.941226 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:09.941205 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 04 18:01:09.941311 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:09.941289 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs podName:349d54df-5bd2-4a3f-8d94-25c6ec118a46 nodeName:}" failed. No retries permitted until 2026-08-04 18:02:13.941273636 +0000 UTC m=+130.244217543 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs") pod "network-metrics-daemon-5brj6" (UID: "349d54df-5bd2-4a3f-8d94-25c6ec118a46") : secret "metrics-daemon-secret" not found Aug 04 18:01:09.942644 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.942629 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Aug 04 18:01:09.942723 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.942630 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Aug 04 18:01:09.942780 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.942634 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6mldd\"" Aug 04 18:01:09.943139 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.943123 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pbf4q\"" Aug 04 18:01:09.943193 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.943136 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Aug 04 18:01:09.946918 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.946899 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m"] Aug 04 18:01:09.949436 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.949407 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cd9c7fccf-j94rd"] Aug 04 18:01:09.964611 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.964589 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8bqx" Aug 04 18:01:09.967064 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:09.966846 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56"] Aug 04 18:01:10.001052 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001017 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-trusted-ca\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.001292 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001271 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-bound-sa-token\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.001546 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001439 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74907d13-f21b-42d4-bbb3-7707a76b3163-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:10.001546 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001520 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001567 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001592 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm9lk\" (UniqueName: \"kubernetes.io/projected/56fc2a53-49c0-4f80-bf24-02d452c17cfc-kube-api-access-lm9lk\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001634 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-certificates\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001661 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-image-registry-private-configuration\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001721 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001755 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-ca-trust-extracted\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001780 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001827 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7596d\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-kube-api-access-7596d\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001852 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-installation-pull-secrets\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.002218 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.001884 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b474m\" (UniqueName: \"kubernetes.io/projected/74907d13-f21b-42d4-bbb3-7707a76b3163-kube-api-access-b474m\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:10.007167 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.007145 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 04 18:01:10.014933 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.014910 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 04 18:01:10.025354 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.025326 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cf89\" (UniqueName: \"kubernetes.io/projected/ae52f154-23ed-4d15-adf7-84bc6f4e80e0-kube-api-access-9cf89\") pod \"network-check-target-q7ttb\" (UID: \"ae52f154-23ed-4d15-adf7-84bc6f4e80e0\") " pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:01:10.090888 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.090815 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w8bqx"] Aug 04 18:01:10.094225 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:10.094199 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7a4076_baf9_4296_a630_843220f1341c.slice/crio-72f3149a7da17dff2e963b7febc02db9b2f9cfb1405a76cdd60bf0379e06cd2b WatchSource:0}: Error finding container 72f3149a7da17dff2e963b7febc02db9b2f9cfb1405a76cdd60bf0379e06cd2b: Status 404 returned error can't find the container with id 72f3149a7da17dff2e963b7febc02db9b2f9cfb1405a76cdd60bf0379e06cd2b Aug 04 18:01:10.102601 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.102578 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b474m\" (UniqueName: \"kubernetes.io/projected/74907d13-f21b-42d4-bbb3-7707a76b3163-kube-api-access-b474m\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:10.102684 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.102611 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-trusted-ca\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.102684 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.102628 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-bound-sa-token\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.102684 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.102669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74907d13-f21b-42d4-bbb3-7707a76b3163-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:10.102817 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.102692 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:10.102817 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.102736 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:10.102913 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.102822 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 04 18:01:10.102913 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.102836 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:10.102913 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.102854 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm9lk\" (UniqueName: \"kubernetes.io/projected/56fc2a53-49c0-4f80-bf24-02d452c17cfc-kube-api-access-lm9lk\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:10.102913 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.102875 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls podName:56fc2a53-49c0-4f80-bf24-02d452c17cfc nodeName:}" failed. No retries permitted until 2026-08-04 18:01:10.602856293 +0000 UTC m=+66.905800212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-wpl56" (UID: "56fc2a53-49c0-4f80-bf24-02d452c17cfc") : secret "samples-operator-tls" not found Aug 04 18:01:10.102913 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.102905 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls podName:74907d13-f21b-42d4-bbb3-7707a76b3163 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:10.602886592 +0000 UTC m=+66.905830506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-cq46m" (UID: "74907d13-f21b-42d4-bbb3-7707a76b3163") : secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:10.103172 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.102962 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-certificates\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.103172 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.102987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-image-registry-private-configuration\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.103172 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.103026 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-ca-trust-extracted\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.103172 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.103046 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.103172 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.103063 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7596d\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-kube-api-access-7596d\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.103172 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.103088 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-installation-pull-secrets\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.103462 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.103229 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 18:01:10.103462 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.103246 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9c7fccf-j94rd: secret "image-registry-tls" not found Aug 04 18:01:10.103462 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.103288 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls podName:7201b21b-5fc5-4ecc-93dd-7f0188e7339f nodeName:}" failed. No retries permitted until 2026-08-04 18:01:10.603273433 +0000 UTC m=+66.906217350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls") pod "image-registry-6cd9c7fccf-j94rd" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f") : secret "image-registry-tls" not found Aug 04 18:01:10.103462 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.103376 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-ca-trust-extracted\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.103670 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.103461 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-certificates\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.103670 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.103530 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-trusted-ca\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.103670 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.103542 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/74907d13-f21b-42d4-bbb3-7707a76b3163-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:10.105409 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.105386 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-image-registry-private-configuration\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.105488 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.105424 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-installation-pull-secrets\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.118072 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.118048 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-bound-sa-token\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.122114 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.122085 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm9lk\" (UniqueName: \"kubernetes.io/projected/56fc2a53-49c0-4f80-bf24-02d452c17cfc-kube-api-access-lm9lk\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:10.122678 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.122659 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7596d\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-kube-api-access-7596d\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.122840 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.122822 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b474m\" (UniqueName: \"kubernetes.io/projected/74907d13-f21b-42d4-bbb3-7707a76b3163-kube-api-access-b474m\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:10.262880 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.262851 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nfg9c\"" Aug 04 18:01:10.269943 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.269923 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:01:10.388976 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.388946 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q7ttb"] Aug 04 18:01:10.392250 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:10.392214 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae52f154_23ed_4d15_adf7_84bc6f4e80e0.slice/crio-938fac8c29ca386e58ad85f854fd37303640be9d5656e95f66d5f915f2c98ca3 WatchSource:0}: Error finding container 938fac8c29ca386e58ad85f854fd37303640be9d5656e95f66d5f915f2c98ca3: Status 404 returned error can't find the container with id 938fac8c29ca386e58ad85f854fd37303640be9d5656e95f66d5f915f2c98ca3 Aug 04 18:01:10.413729 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.413698 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q7ttb" event={"ID":"ae52f154-23ed-4d15-adf7-84bc6f4e80e0","Type":"ContainerStarted","Data":"938fac8c29ca386e58ad85f854fd37303640be9d5656e95f66d5f915f2c98ca3"} Aug 04 18:01:10.414747 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.414726 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w8bqx" event={"ID":"ab7a4076-baf9-4296-a630-843220f1341c","Type":"ContainerStarted","Data":"72f3149a7da17dff2e963b7febc02db9b2f9cfb1405a76cdd60bf0379e06cd2b"} Aug 04 18:01:10.607324 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.607227 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:10.607324 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.607292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:10.607596 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:10.607347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:10.607596 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.607387 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 04 18:01:10.607596 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.607442 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:10.607596 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.607453 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls podName:56fc2a53-49c0-4f80-bf24-02d452c17cfc nodeName:}" failed. No retries permitted until 2026-08-04 18:01:11.607439955 +0000 UTC m=+67.910383858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-wpl56" (UID: "56fc2a53-49c0-4f80-bf24-02d452c17cfc") : secret "samples-operator-tls" not found Aug 04 18:01:10.607596 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.607490 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls podName:74907d13-f21b-42d4-bbb3-7707a76b3163 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:11.607476336 +0000 UTC m=+67.910420253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-cq46m" (UID: "74907d13-f21b-42d4-bbb3-7707a76b3163") : secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:10.607596 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.607444 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 18:01:10.607596 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.607530 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9c7fccf-j94rd: secret "image-registry-tls" not found Aug 04 18:01:10.607596 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:10.607575 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls podName:7201b21b-5fc5-4ecc-93dd-7f0188e7339f nodeName:}" failed. No retries permitted until 2026-08-04 18:01:11.607561162 +0000 UTC m=+67.910505066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls") pod "image-registry-6cd9c7fccf-j94rd" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f") : secret "image-registry-tls" not found Aug 04 18:01:11.413169 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:11.413111 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:01:11.413623 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:11.413346 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 04 18:01:11.413623 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:11.413425 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls podName:d539a6c0-c527-43c8-b9b2-ae8137a4e7a8 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:43.413405374 +0000 UTC m=+99.716349277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls") pod "dns-default-42kq7" (UID: "d539a6c0-c527-43c8-b9b2-ae8137a4e7a8") : secret "dns-default-metrics-tls" not found Aug 04 18:01:11.615236 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:11.615191 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:11.615420 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:11.615363 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:11.615420 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:11.615397 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 04 18:01:11.615795 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:11.615459 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:11.615795 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:11.615515 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 18:01:11.615795 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:11.615533 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9c7fccf-j94rd: secret "image-registry-tls" not found Aug 04 18:01:11.615795 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:11.615538 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls podName:56fc2a53-49c0-4f80-bf24-02d452c17cfc nodeName:}" failed. No retries permitted until 2026-08-04 18:01:13.615519977 +0000 UTC m=+69.918463881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-wpl56" (UID: "56fc2a53-49c0-4f80-bf24-02d452c17cfc") : secret "samples-operator-tls" not found Aug 04 18:01:11.615795 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:11.615590 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls podName:7201b21b-5fc5-4ecc-93dd-7f0188e7339f nodeName:}" failed. No retries permitted until 2026-08-04 18:01:13.615578898 +0000 UTC m=+69.918522806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls") pod "image-registry-6cd9c7fccf-j94rd" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f") : secret "image-registry-tls" not found Aug 04 18:01:11.615795 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:11.615625 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:11.615795 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:11.615687 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls podName:74907d13-f21b-42d4-bbb3-7707a76b3163 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:13.615669108 +0000 UTC m=+69.918613017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-cq46m" (UID: "74907d13-f21b-42d4-bbb3-7707a76b3163") : secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:12.113951 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.113911 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk"] Aug 04 18:01:12.124072 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.124046 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:12.127009 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.126765 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-zmgk7\"" Aug 04 18:01:12.127131 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.127018 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Aug 04 18:01:12.127131 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.127018 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Aug 04 18:01:12.131809 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.131780 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk"] Aug 04 18:01:12.222286 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.222251 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:12.222478 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.222343 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9060763-2b35-457a-879d-648b1cec246d-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:12.323156 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.322967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:12.323156 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.323133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9060763-2b35-457a-879d-648b1cec246d-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:12.323385 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:12.323140 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 04 18:01:12.323385 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:12.323270 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert podName:d9060763-2b35-457a-879d-648b1cec246d nodeName:}" failed. No retries permitted until 2026-08-04 18:01:12.823248487 +0000 UTC m=+69.126192393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5zmkk" (UID: "d9060763-2b35-457a-879d-648b1cec246d") : secret "networking-console-plugin-cert" not found Aug 04 18:01:12.323941 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.323896 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d9060763-2b35-457a-879d-648b1cec246d-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:12.829484 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:12.829441 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:12.829884 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:12.829650 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 04 18:01:12.829884 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:12.829726 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert podName:d9060763-2b35-457a-879d-648b1cec246d nodeName:}" failed. No retries permitted until 2026-08-04 18:01:13.829704476 +0000 UTC m=+70.132648389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5zmkk" (UID: "d9060763-2b35-457a-879d-648b1cec246d") : secret "networking-console-plugin-cert" not found Aug 04 18:01:13.636027 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:13.635976 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:13.636262 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:13.636040 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:13.636262 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:13.636149 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:13.636262 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:13.636188 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:13.636262 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:13.636218 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls podName:74907d13-f21b-42d4-bbb3-7707a76b3163 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:17.636198663 +0000 UTC m=+73.939142585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-cq46m" (UID: "74907d13-f21b-42d4-bbb3-7707a76b3163") : secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:13.636262 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:13.636153 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 04 18:01:13.636262 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:13.636264 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 18:01:13.636581 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:13.636276 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9c7fccf-j94rd: secret "image-registry-tls" not found Aug 04 18:01:13.636581 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:13.636318 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls podName:56fc2a53-49c0-4f80-bf24-02d452c17cfc nodeName:}" failed. No retries permitted until 2026-08-04 18:01:17.636297121 +0000 UTC m=+73.939241048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-wpl56" (UID: "56fc2a53-49c0-4f80-bf24-02d452c17cfc") : secret "samples-operator-tls" not found Aug 04 18:01:13.636581 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:13.636345 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls podName:7201b21b-5fc5-4ecc-93dd-7f0188e7339f nodeName:}" failed. No retries permitted until 2026-08-04 18:01:17.636335455 +0000 UTC m=+73.939279363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls") pod "image-registry-6cd9c7fccf-j94rd" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f") : secret "image-registry-tls" not found Aug 04 18:01:13.838096 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:13.838053 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:13.838521 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:13.838070 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 04 18:01:13.838521 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:13.838196 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert podName:d9060763-2b35-457a-879d-648b1cec246d nodeName:}" failed. No retries permitted until 2026-08-04 18:01:15.8381787 +0000 UTC m=+72.141122606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5zmkk" (UID: "d9060763-2b35-457a-879d-648b1cec246d") : secret "networking-console-plugin-cert" not found Aug 04 18:01:15.091817 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.091785 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j84dm"] Aug 04 18:01:15.105717 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.105683 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.106199 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.106173 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j84dm"] Aug 04 18:01:15.108429 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.108408 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 04 18:01:15.108673 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.108654 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 04 18:01:15.108787 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.108676 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vx672\"" Aug 04 18:01:15.109264 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.109235 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 04 18:01:15.109264 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.109241 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 04 18:01:15.150260 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.150227 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.150260 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.150265 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.150475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.150292 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6608edeb-3048-446d-a8fb-9c0af93b115a-data-volume\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.150475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.150347 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g5l6\" (UniqueName: \"kubernetes.io/projected/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-api-access-7g5l6\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.150475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.150424 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6608edeb-3048-446d-a8fb-9c0af93b115a-crio-socket\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.251073 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.251035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6608edeb-3048-446d-a8fb-9c0af93b115a-crio-socket\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.251205 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.251099 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.251205 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.251131 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.251205 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.251138 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6608edeb-3048-446d-a8fb-9c0af93b115a-crio-socket\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.251205 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.251166 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6608edeb-3048-446d-a8fb-9c0af93b115a-data-volume\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.251205 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.251205 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g5l6\" (UniqueName: \"kubernetes.io/projected/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-api-access-7g5l6\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.251446 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.251221 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 18:01:15.251446 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.251281 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:15.751265353 +0000 UTC m=+72.054209286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : configmap "kube-rbac-proxy" not found Aug 04 18:01:15.251446 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.251362 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 18:01:15.251446 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.251398 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:15.751389298 +0000 UTC m=+72.054333205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : secret "insights-runtime-extractor-tls" not found Aug 04 18:01:15.251446 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.251435 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6608edeb-3048-446d-a8fb-9c0af93b115a-data-volume\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.265421 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.265387 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g5l6\" (UniqueName: \"kubernetes.io/projected/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-api-access-7g5l6\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.430081 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.430043 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q7ttb" event={"ID":"ae52f154-23ed-4d15-adf7-84bc6f4e80e0","Type":"ContainerStarted","Data":"6c3aee1e3ce3b8bae7247b95e6e0c01af5a5a9f99689996971278f017f00c056"} Aug 04 18:01:15.430333 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.430135 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:01:15.431400 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.431379 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w8bqx" event={"ID":"ab7a4076-baf9-4296-a630-843220f1341c","Type":"ContainerStarted","Data":"f85c6a717e2249aaf95862c5c9393f93201a961a12dc2d34633c0c20b615a47d"} Aug 04 18:01:15.460226 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.460169 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q7ttb" podStartSLOduration=65.688482419 podStartE2EDuration="1m10.460149138s" totalImagesPullingTime="4.771666719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:15.459936674 +0000 UTC m=+71.762880597" watchObservedRunningTime="2026-08-04 18:01:15.460149138 +0000 UTC m=+71.763093057" Aug 04 18:01:15.497351 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.497301 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w8bqx" podStartSLOduration=65.424069353 podStartE2EDuration="1m10.497281307s" totalImagesPullingTime="5.073211954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:15.494447679 +0000 UTC m=+71.797391603" watchObservedRunningTime="2026-08-04 18:01:15.497281307 +0000 UTC m=+71.800225233" Aug 04 18:01:15.756021 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.755931 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.756021 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.755970 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:15.756204 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.756048 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 18:01:15.756204 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.756075 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 18:01:15.756204 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.756116 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:16.756099127 +0000 UTC m=+73.059043030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : configmap "kube-rbac-proxy" not found Aug 04 18:01:15.756204 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.756130 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:16.756123996 +0000 UTC m=+73.059067899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : secret "insights-runtime-extractor-tls" not found Aug 04 18:01:15.857427 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:15.857385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:15.857621 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.857547 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 04 18:01:15.857621 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:15.857611 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert podName:d9060763-2b35-457a-879d-648b1cec246d nodeName:}" failed. No retries permitted until 2026-08-04 18:01:19.85759354 +0000 UTC m=+76.160537444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5zmkk" (UID: "d9060763-2b35-457a-879d-648b1cec246d") : secret "networking-console-plugin-cert" not found Aug 04 18:01:16.764234 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:16.764195 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:16.764234 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:16.764240 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:16.764781 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:16.764319 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 18:01:16.764781 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:16.764394 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:18.764379967 +0000 UTC m=+75.067323871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : configmap "kube-rbac-proxy" not found Aug 04 18:01:16.764781 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:16.764409 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 18:01:16.764781 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:16.764462 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:18.764448147 +0000 UTC m=+75.067392066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : secret "insights-runtime-extractor-tls" not found Aug 04 18:01:17.119048 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.119013 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-b4dv5"] Aug 04 18:01:17.121070 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.121055 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.123688 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.123662 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Aug 04 18:01:17.123793 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.123777 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-46rxz\"" Aug 04 18:01:17.124632 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.124617 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Aug 04 18:01:17.124712 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.124656 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Aug 04 18:01:17.124767 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.124739 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Aug 04 18:01:17.131777 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.131755 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-b4dv5"] Aug 04 18:01:17.167833 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.167790 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tzp7\" (UniqueName: \"kubernetes.io/projected/00179394-3a0f-426c-b8d3-1c4afe8d426b-kube-api-access-8tzp7\") pod \"service-ca-98c88fbb5-b4dv5\" (UID: \"00179394-3a0f-426c-b8d3-1c4afe8d426b\") " pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.168002 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.167854 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/00179394-3a0f-426c-b8d3-1c4afe8d426b-signing-cabundle\") pod \"service-ca-98c88fbb5-b4dv5\" (UID: \"00179394-3a0f-426c-b8d3-1c4afe8d426b\") " pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.168002 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.167979 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/00179394-3a0f-426c-b8d3-1c4afe8d426b-signing-key\") pod \"service-ca-98c88fbb5-b4dv5\" (UID: \"00179394-3a0f-426c-b8d3-1c4afe8d426b\") " pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.243851 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.243821 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vn24x_27c0e506-b7da-4130-acac-c0140c7a8a18/dns-node-resolver/0.log" Aug 04 18:01:17.269310 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.269272 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/00179394-3a0f-426c-b8d3-1c4afe8d426b-signing-key\") pod \"service-ca-98c88fbb5-b4dv5\" (UID: \"00179394-3a0f-426c-b8d3-1c4afe8d426b\") " pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.269396 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.269354 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tzp7\" (UniqueName: \"kubernetes.io/projected/00179394-3a0f-426c-b8d3-1c4afe8d426b-kube-api-access-8tzp7\") pod \"service-ca-98c88fbb5-b4dv5\" (UID: \"00179394-3a0f-426c-b8d3-1c4afe8d426b\") " pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.269396 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.269390 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/00179394-3a0f-426c-b8d3-1c4afe8d426b-signing-cabundle\") pod \"service-ca-98c88fbb5-b4dv5\" (UID: \"00179394-3a0f-426c-b8d3-1c4afe8d426b\") " pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.270053 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.270027 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/00179394-3a0f-426c-b8d3-1c4afe8d426b-signing-cabundle\") pod \"service-ca-98c88fbb5-b4dv5\" (UID: \"00179394-3a0f-426c-b8d3-1c4afe8d426b\") " pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.271610 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.271593 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/00179394-3a0f-426c-b8d3-1c4afe8d426b-signing-key\") pod \"service-ca-98c88fbb5-b4dv5\" (UID: \"00179394-3a0f-426c-b8d3-1c4afe8d426b\") " pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.278845 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.278825 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tzp7\" (UniqueName: \"kubernetes.io/projected/00179394-3a0f-426c-b8d3-1c4afe8d426b-kube-api-access-8tzp7\") pod \"service-ca-98c88fbb5-b4dv5\" (UID: \"00179394-3a0f-426c-b8d3-1c4afe8d426b\") " pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.429645 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.429544 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" Aug 04 18:01:17.553394 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.553362 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-b4dv5"] Aug 04 18:01:17.556155 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:17.556125 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00179394_3a0f_426c_b8d3_1c4afe8d426b.slice/crio-f771eb1851b39f736f36365dd188fb7dd6ddabbfa32c16ffa1c440aeaabf86a1 WatchSource:0}: Error finding container f771eb1851b39f736f36365dd188fb7dd6ddabbfa32c16ffa1c440aeaabf86a1: Status 404 returned error can't find the container with id f771eb1851b39f736f36365dd188fb7dd6ddabbfa32c16ffa1c440aeaabf86a1 Aug 04 18:01:17.672657 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.672622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:17.672838 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.672701 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:17.672838 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.672733 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:17.672838 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:17.672788 2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 04 18:01:17.672838 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:17.672822 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:17.672838 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:17.672830 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 04 18:01:17.673016 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:17.672846 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cd9c7fccf-j94rd: secret "image-registry-tls" not found Aug 04 18:01:17.673016 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:17.672865 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls podName:56fc2a53-49c0-4f80-bf24-02d452c17cfc nodeName:}" failed. No retries permitted until 2026-08-04 18:01:25.672849184 +0000 UTC m=+81.975793087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-wpl56" (UID: "56fc2a53-49c0-4f80-bf24-02d452c17cfc") : secret "samples-operator-tls" not found Aug 04 18:01:17.673016 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:17.672880 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls podName:74907d13-f21b-42d4-bbb3-7707a76b3163 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:25.672874113 +0000 UTC m=+81.975818016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-cq46m" (UID: "74907d13-f21b-42d4-bbb3-7707a76b3163") : secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:17.673016 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:17.672891 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls podName:7201b21b-5fc5-4ecc-93dd-7f0188e7339f nodeName:}" failed. No retries permitted until 2026-08-04 18:01:25.672885488 +0000 UTC m=+81.975829392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls") pod "image-registry-6cd9c7fccf-j94rd" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f") : secret "image-registry-tls" not found Aug 04 18:01:17.843740 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:17.843652 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n8zd2_83c7dd22-1e03-4b09-a372-2cddfbbafb32/node-ca/0.log" Aug 04 18:01:18.438944 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:18.438913 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" event={"ID":"00179394-3a0f-426c-b8d3-1c4afe8d426b","Type":"ContainerStarted","Data":"f771eb1851b39f736f36365dd188fb7dd6ddabbfa32c16ffa1c440aeaabf86a1"} Aug 04 18:01:18.644673 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:18.644646 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6s7g8_940a334e-5559-4412-b378-6c59a51da197/serve-healthcheck-canary/0.log" Aug 04 18:01:18.783049 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:18.782964 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:18.783222 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:18.783072 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:18.783222 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:18.783128 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 18:01:18.783222 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:18.783178 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 18:01:18.783222 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:18.783204 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:22.783184669 +0000 UTC m=+79.086128587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : secret "insights-runtime-extractor-tls" not found Aug 04 18:01:18.783421 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:18.783231 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:22.783219339 +0000 UTC m=+79.086163242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : configmap "kube-rbac-proxy" not found Aug 04 18:01:19.443600 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:19.443571 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" event={"ID":"00179394-3a0f-426c-b8d3-1c4afe8d426b","Type":"ContainerStarted","Data":"c99799434bc4e74112142ef7770991326b236692fbd5152cce8041f82f13fb81"} Aug 04 18:01:19.462301 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:19.462251 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-b4dv5" podStartSLOduration=0.682930135 podStartE2EDuration="2.462234896s" totalImagesPullingTime="1.779304761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:19.461965746 +0000 UTC m=+75.764909671" watchObservedRunningTime="2026-08-04 18:01:19.462234896 +0000 UTC m=+75.765178823" Aug 04 18:01:19.892288 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:19.892248 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:19.892463 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:19.892417 2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 04 18:01:19.892518 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:19.892483 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert podName:d9060763-2b35-457a-879d-648b1cec246d nodeName:}" failed. No retries permitted until 2026-08-04 18:01:27.892466824 +0000 UTC m=+84.195410744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-5zmkk" (UID: "d9060763-2b35-457a-879d-648b1cec246d") : secret "networking-console-plugin-cert" not found Aug 04 18:01:22.816308 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:22.816274 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:22.816750 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:22.816365 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:22.816750 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:22.816442 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 04 18:01:22.816750 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:22.816481 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 04 18:01:22.816750 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:22.816517 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:30.816492793 +0000 UTC m=+87.119436700 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : secret "insights-runtime-extractor-tls" not found Aug 04 18:01:22.816750 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:22.816541 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm podName:6608edeb-3048-446d-a8fb-9c0af93b115a nodeName:}" failed. No retries permitted until 2026-08-04 18:01:30.81652901 +0000 UTC m=+87.119472913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j84dm" (UID: "6608edeb-3048-446d-a8fb-9c0af93b115a") : configmap "kube-rbac-proxy" not found Aug 04 18:01:25.739392 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:25.739355 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:25.739822 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:25.739411 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:25.739822 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:25.739466 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:25.739822 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:25.739542 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:25.739822 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:01:25.739625 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls podName:74907d13-f21b-42d4-bbb3-7707a76b3163 nodeName:}" failed. No retries permitted until 2026-08-04 18:01:41.739602961 +0000 UTC m=+98.042546882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-cq46m" (UID: "74907d13-f21b-42d4-bbb3-7707a76b3163") : secret "cluster-monitoring-operator-tls" not found Aug 04 18:01:25.741814 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:25.741796 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") pod \"image-registry-6cd9c7fccf-j94rd\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:25.741869 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:25.741851 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/56fc2a53-49c0-4f80-bf24-02d452c17cfc-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-wpl56\" (UID: \"56fc2a53-49c0-4f80-bf24-02d452c17cfc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:25.804448 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:25.804414 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:25.809280 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:25.809260 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" Aug 04 18:01:25.938022 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:25.937995 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cd9c7fccf-j94rd"] Aug 04 18:01:25.939474 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:25.939447 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7201b21b_5fc5_4ecc_93dd_7f0188e7339f.slice/crio-9de56c66f54ea143463e92c1805dd09151b5da952f4de44b26ca0d2b17443c21 WatchSource:0}: Error finding container 9de56c66f54ea143463e92c1805dd09151b5da952f4de44b26ca0d2b17443c21: Status 404 returned error can't find the container with id 9de56c66f54ea143463e92c1805dd09151b5da952f4de44b26ca0d2b17443c21 Aug 04 18:01:25.951797 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:25.951776 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56"] Aug 04 18:01:26.463650 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:26.463611 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" event={"ID":"56fc2a53-49c0-4f80-bf24-02d452c17cfc","Type":"ContainerStarted","Data":"21e4aef3c8e6462dd359f6fd922ad059c5c52a4614d7174711575de9604fa81d"} Aug 04 18:01:26.465074 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:26.465026 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" event={"ID":"7201b21b-5fc5-4ecc-93dd-7f0188e7339f","Type":"ContainerStarted","Data":"e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965"} Aug 04 18:01:26.465197 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:26.465088 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" event={"ID":"7201b21b-5fc5-4ecc-93dd-7f0188e7339f","Type":"ContainerStarted","Data":"9de56c66f54ea143463e92c1805dd09151b5da952f4de44b26ca0d2b17443c21"} Aug 04 18:01:26.465197 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:26.465165 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:26.489295 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:26.489245 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" podStartSLOduration=17.489230468 podStartE2EDuration="17.489230468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:26.487624628 +0000 UTC m=+82.790568553" watchObservedRunningTime="2026-08-04 18:01:26.489230468 +0000 UTC m=+82.792174392" Aug 04 18:01:27.957020 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:27.956984 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:27.959370 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:27.959349 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d9060763-2b35-457a-879d-648b1cec246d-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-5zmkk\" (UID: \"d9060763-2b35-457a-879d-648b1cec246d\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:28.035782 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:28.035751 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" Aug 04 18:01:28.153757 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:28.153733 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk"] Aug 04 18:01:28.154422 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:28.154398 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9060763_2b35_457a_879d_648b1cec246d.slice/crio-afdd539ed0254a8ced2c51b6a9f553b761ce2873f232897b9f319bb5020f4f30 WatchSource:0}: Error finding container afdd539ed0254a8ced2c51b6a9f553b761ce2873f232897b9f319bb5020f4f30: Status 404 returned error can't find the container with id afdd539ed0254a8ced2c51b6a9f553b761ce2873f232897b9f319bb5020f4f30 Aug 04 18:01:28.471660 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:28.471627 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" event={"ID":"d9060763-2b35-457a-879d-648b1cec246d","Type":"ContainerStarted","Data":"afdd539ed0254a8ced2c51b6a9f553b761ce2873f232897b9f319bb5020f4f30"} Aug 04 18:01:30.478812 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:30.478775 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" event={"ID":"56fc2a53-49c0-4f80-bf24-02d452c17cfc","Type":"ContainerStarted","Data":"efd4105bb5503ccec2d802bb7b47e03f0fbf18cfad88fc315b8274f0ed287144"} Aug 04 18:01:30.479233 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:30.478829 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" event={"ID":"56fc2a53-49c0-4f80-bf24-02d452c17cfc","Type":"ContainerStarted","Data":"ee9d31852839c3611b51802c22eeee4d50757edc43f0d996d0ad4619aa987623"} Aug 04 18:01:30.480146 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:30.480123 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" event={"ID":"d9060763-2b35-457a-879d-648b1cec246d","Type":"ContainerStarted","Data":"9e8e0d05b86662d4c1dde1a4e937df98710578c9c746d5623bdeb06e2955b9f2"} Aug 04 18:01:30.498934 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:30.498887 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-wpl56" podStartSLOduration=17.559122335 podStartE2EDuration="21.498872344s" totalImagesPullingTime="3.939750009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:30.497840439 +0000 UTC m=+86.800784365" watchObservedRunningTime="2026-08-04 18:01:30.498872344 +0000 UTC m=+86.801816269" Aug 04 18:01:30.516206 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:30.516153 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-5zmkk" podStartSLOduration=16.740490567 podStartE2EDuration="18.516137504s" totalImagesPullingTime="1.775646937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:30.515024299 +0000 UTC m=+86.817968225" watchObservedRunningTime="2026-08-04 18:01:30.516137504 +0000 UTC m=+86.819081428" Aug 04 18:01:30.884846 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:30.884819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:30.885007 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:30.884884 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:30.885318 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:30.885299 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6608edeb-3048-446d-a8fb-9c0af93b115a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:30.887052 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:30.887036 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6608edeb-3048-446d-a8fb-9c0af93b115a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j84dm\" (UID: \"6608edeb-3048-446d-a8fb-9c0af93b115a\") " pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:31.015252 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:31.015208 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j84dm" Aug 04 18:01:31.131826 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:31.131791 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j84dm"] Aug 04 18:01:31.135563 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:31.135513 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6608edeb_3048_446d_a8fb_9c0af93b115a.slice/crio-ac2fde150801cc3ebe24340b92ab5bec2d3a3c48076c8658821b0b430e43d627 WatchSource:0}: Error finding container ac2fde150801cc3ebe24340b92ab5bec2d3a3c48076c8658821b0b430e43d627: Status 404 returned error can't find the container with id ac2fde150801cc3ebe24340b92ab5bec2d3a3c48076c8658821b0b430e43d627 Aug 04 18:01:31.484852 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:31.484765 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j84dm" event={"ID":"6608edeb-3048-446d-a8fb-9c0af93b115a","Type":"ContainerStarted","Data":"04f0d7753d4db8376f45b48c1ba629a4fc632a46bb178bf678313ea3fb2f816c"} Aug 04 18:01:31.484852 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:31.484829 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j84dm" event={"ID":"6608edeb-3048-446d-a8fb-9c0af93b115a","Type":"ContainerStarted","Data":"ac2fde150801cc3ebe24340b92ab5bec2d3a3c48076c8658821b0b430e43d627"} Aug 04 18:01:32.493128 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:32.493089 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j84dm" event={"ID":"6608edeb-3048-446d-a8fb-9c0af93b115a","Type":"ContainerStarted","Data":"7106c672a0f3e725aebf00f5af760f969bf69c1c36cddd6b461a13a428b08e2d"} Aug 04 18:01:33.498819 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:33.498780 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j84dm" event={"ID":"6608edeb-3048-446d-a8fb-9c0af93b115a","Type":"ContainerStarted","Data":"a0a64a1e6233d1726f1c0242d39b844fb3cc7a1bafa1cba851c6640031643a32"} Aug 04 18:01:33.517858 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:33.517815 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j84dm" podStartSLOduration=16.853511747 podStartE2EDuration="18.517800619s" totalImagesPullingTime="1.664288872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:01:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:33.516314205 +0000 UTC m=+89.819258129" watchObservedRunningTime="2026-08-04 18:01:33.517800619 +0000 UTC m=+89.820744543" Aug 04 18:01:39.118723 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.118690 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cd9c7fccf-j94rd"] Aug 04 18:01:39.125241 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.125213 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm"] Aug 04 18:01:39.127466 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.127448 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.129722 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.129700 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Aug 04 18:01:39.130555 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.130536 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Aug 04 18:01:39.130670 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.130611 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Aug 04 18:01:39.130885 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.130871 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Aug 04 18:01:39.139092 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.139068 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm"] Aug 04 18:01:39.174234 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.174206 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f79dc8896-zvsv9"] Aug 04 18:01:39.176159 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.176144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.207247 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.207225 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f79dc8896-zvsv9"] Aug 04 18:01:39.249566 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249533 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-bound-sa-token\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.249727 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249579 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f93d82eb-a916-4906-a651-66ea251c809d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7996549886-4wtwm\" (UID: \"f93d82eb-a916-4906-a651-66ea251c809d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.249727 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249600 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-registry-certificates\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.249727 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249630 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-registry-tls\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.249727 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249655 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-ca-trust-extracted\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.249727 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249680 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-image-registry-private-configuration\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.249905 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249725 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-installation-pull-secrets\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.249905 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249823 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-trusted-ca\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.249974 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249940 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bljn6\" (UniqueName: \"kubernetes.io/projected/f93d82eb-a916-4906-a651-66ea251c809d-kube-api-access-bljn6\") pod \"klusterlet-addon-workmgr-7996549886-4wtwm\" (UID: \"f93d82eb-a916-4906-a651-66ea251c809d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.250020 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.249970 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb6qr\" (UniqueName: \"kubernetes.io/projected/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-kube-api-access-cb6qr\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.250073 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.250036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f93d82eb-a916-4906-a651-66ea251c809d-tmp\") pod \"klusterlet-addon-workmgr-7996549886-4wtwm\" (UID: \"f93d82eb-a916-4906-a651-66ea251c809d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.350543 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350489 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-bound-sa-token\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.350688 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350557 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f93d82eb-a916-4906-a651-66ea251c809d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7996549886-4wtwm\" (UID: \"f93d82eb-a916-4906-a651-66ea251c809d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.350688 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350584 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-registry-certificates\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.350688 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350614 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-registry-tls\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.350857 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350740 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-ca-trust-extracted\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.350857 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350783 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-image-registry-private-configuration\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.350857 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350816 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-installation-pull-secrets\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.350998 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350880 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-trusted-ca\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.350998 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350920 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bljn6\" (UniqueName: \"kubernetes.io/projected/f93d82eb-a916-4906-a651-66ea251c809d-kube-api-access-bljn6\") pod \"klusterlet-addon-workmgr-7996549886-4wtwm\" (UID: \"f93d82eb-a916-4906-a651-66ea251c809d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.350998 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350947 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb6qr\" (UniqueName: \"kubernetes.io/projected/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-kube-api-access-cb6qr\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.350998 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.350984 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f93d82eb-a916-4906-a651-66ea251c809d-tmp\") pod \"klusterlet-addon-workmgr-7996549886-4wtwm\" (UID: \"f93d82eb-a916-4906-a651-66ea251c809d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.351179 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.351102 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-ca-trust-extracted\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.351430 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.351405 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f93d82eb-a916-4906-a651-66ea251c809d-tmp\") pod \"klusterlet-addon-workmgr-7996549886-4wtwm\" (UID: \"f93d82eb-a916-4906-a651-66ea251c809d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.351601 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.351550 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-registry-certificates\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.352001 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.351973 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-trusted-ca\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.353382 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.353359 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f93d82eb-a916-4906-a651-66ea251c809d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7996549886-4wtwm\" (UID: \"f93d82eb-a916-4906-a651-66ea251c809d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.353382 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.353376 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-registry-tls\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.353520 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.353359 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-installation-pull-secrets\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.353629 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.353615 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-image-registry-private-configuration\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.358127 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.358099 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-bound-sa-token\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.359271 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.359233 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bljn6\" (UniqueName: \"kubernetes.io/projected/f93d82eb-a916-4906-a651-66ea251c809d-kube-api-access-bljn6\") pod \"klusterlet-addon-workmgr-7996549886-4wtwm\" (UID: \"f93d82eb-a916-4906-a651-66ea251c809d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.360515 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.360485 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb6qr\" (UniqueName: \"kubernetes.io/projected/a4fa8bfc-222e-4487-bfed-f99a3fe90afc-kube-api-access-cb6qr\") pod \"image-registry-7f79dc8896-zvsv9\" (UID: \"a4fa8bfc-222e-4487-bfed-f99a3fe90afc\") " pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.437256 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.437167 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:39.484331 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.484295 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:39.584990 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.584917 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm"] Aug 04 18:01:39.587323 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:39.587283 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93d82eb_a916_4906_a651_66ea251c809d.slice/crio-e6fc5fa657034ce66f11053c49d85e8d38f12f447f0e6ed3b2bc569eb8eecb3b WatchSource:0}: Error finding container e6fc5fa657034ce66f11053c49d85e8d38f12f447f0e6ed3b2bc569eb8eecb3b: Status 404 returned error can't find the container with id e6fc5fa657034ce66f11053c49d85e8d38f12f447f0e6ed3b2bc569eb8eecb3b Aug 04 18:01:39.643996 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:39.643969 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f79dc8896-zvsv9"] Aug 04 18:01:39.645337 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:39.645313 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4fa8bfc_222e_4487_bfed_f99a3fe90afc.slice/crio-df563c37780b7b031bdaca3490e2499a7a8cec51c051f98fb94368dd989f9503 WatchSource:0}: Error finding container df563c37780b7b031bdaca3490e2499a7a8cec51c051f98fb94368dd989f9503: Status 404 returned error can't find the container with id df563c37780b7b031bdaca3490e2499a7a8cec51c051f98fb94368dd989f9503 Aug 04 18:01:40.524323 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:40.524283 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" event={"ID":"a4fa8bfc-222e-4487-bfed-f99a3fe90afc","Type":"ContainerStarted","Data":"8511b879c8726a2d58bedda0545c77ce13f84c6e2b11b64f8735bce04b77a271"} Aug 04 18:01:40.524815 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:40.524493 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:01:40.524815 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:40.524549 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" event={"ID":"a4fa8bfc-222e-4487-bfed-f99a3fe90afc","Type":"ContainerStarted","Data":"df563c37780b7b031bdaca3490e2499a7a8cec51c051f98fb94368dd989f9503"} Aug 04 18:01:40.525732 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:40.525701 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" event={"ID":"f93d82eb-a916-4906-a651-66ea251c809d","Type":"ContainerStarted","Data":"e6fc5fa657034ce66f11053c49d85e8d38f12f447f0e6ed3b2bc569eb8eecb3b"} Aug 04 18:01:40.550624 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:40.550572 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" podStartSLOduration=1.550556619 podStartE2EDuration="1.550556619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:40.548798419 +0000 UTC m=+96.851742344" watchObservedRunningTime="2026-08-04 18:01:40.550556619 +0000 UTC m=+96.853500542" Aug 04 18:01:41.775834 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:41.775799 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:41.777957 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:41.777930 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/74907d13-f21b-42d4-bbb3-7707a76b3163-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-cq46m\" (UID: \"74907d13-f21b-42d4-bbb3-7707a76b3163\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:42.014159 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:42.014118 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" Aug 04 18:01:42.971868 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:42.971836 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m"] Aug 04 18:01:42.975047 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:42.975014 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74907d13_f21b_42d4_bbb3_7707a76b3163.slice/crio-6518da6cbd7f58738118bdb683818dcc359a972aa4082c3a1682fbfe4cb7b51c WatchSource:0}: Error finding container 6518da6cbd7f58738118bdb683818dcc359a972aa4082c3a1682fbfe4cb7b51c: Status 404 returned error can't find the container with id 6518da6cbd7f58738118bdb683818dcc359a972aa4082c3a1682fbfe4cb7b51c Aug 04 18:01:43.490398 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.490363 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:01:43.492550 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.492531 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d539a6c0-c527-43c8-b9b2-ae8137a4e7a8-metrics-tls\") pod \"dns-default-42kq7\" (UID: \"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8\") " pod="openshift-dns/dns-default-42kq7" Aug 04 18:01:43.501195 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.501172 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k2cqb\"" Aug 04 18:01:43.509191 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.509174 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-42kq7" Aug 04 18:01:43.538005 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.537962 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" event={"ID":"74907d13-f21b-42d4-bbb3-7707a76b3163","Type":"ContainerStarted","Data":"6518da6cbd7f58738118bdb683818dcc359a972aa4082c3a1682fbfe4cb7b51c"} Aug 04 18:01:43.539943 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.539680 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" event={"ID":"f93d82eb-a916-4906-a651-66ea251c809d","Type":"ContainerStarted","Data":"9b3dbe2a763cf0bb6563a92f6db161b66f756e7b6343fcdeb03db29594ef43da"} Aug 04 18:01:43.539943 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.539829 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:43.541404 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.541381 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" Aug 04 18:01:43.560991 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.560931 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7996549886-4wtwm" podStartSLOduration=1.257875643 podStartE2EDuration="4.560908462s" totalImagesPullingTime="3.303032819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:43.559447122 +0000 UTC m=+99.862391058" watchObservedRunningTime="2026-08-04 18:01:43.560908462 +0000 UTC m=+99.863852388" Aug 04 18:01:43.645293 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:43.645272 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-42kq7"] Aug 04 18:01:43.647368 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:43.647342 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd539a6c0_c527_43c8_b9b2_ae8137a4e7a8.slice/crio-47f9381ff96f6094ea58cd79671df0b7af432ab194419c84fec51c04c87eb702 WatchSource:0}: Error finding container 47f9381ff96f6094ea58cd79671df0b7af432ab194419c84fec51c04c87eb702: Status 404 returned error can't find the container with id 47f9381ff96f6094ea58cd79671df0b7af432ab194419c84fec51c04c87eb702 Aug 04 18:01:44.543518 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:44.543465 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-42kq7" event={"ID":"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8","Type":"ContainerStarted","Data":"47f9381ff96f6094ea58cd79671df0b7af432ab194419c84fec51c04c87eb702"} Aug 04 18:01:45.548731 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:45.548688 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" event={"ID":"74907d13-f21b-42d4-bbb3-7707a76b3163","Type":"ContainerStarted","Data":"8f2753a3951987a66d0bbb322f5c9ea962f6f997944c52189f578efb6bdb799d"} Aug 04 18:01:46.435567 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:46.435534 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q7ttb" Aug 04 18:01:46.473987 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:46.473940 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" podStartSLOduration=35.936244318 podStartE2EDuration="37.473923756s" totalImagesPullingTime="1.537679438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:45.567083854 +0000 UTC m=+101.870027780" watchObservedRunningTime="2026-08-04 18:01:46.473923756 +0000 UTC m=+102.776867680" Aug 04 18:01:46.553246 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:46.553211 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-42kq7" event={"ID":"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8","Type":"ContainerStarted","Data":"ebb7d193d5c5fcd7b96fe4c4edf97eee99669559e8a80c77fba3445ff0605773"} Aug 04 18:01:46.553701 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:46.553262 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-42kq7" event={"ID":"d539a6c0-c527-43c8-b9b2-ae8137a4e7a8","Type":"ContainerStarted","Data":"58948b673d06b4e71a8d845286c02ab514c3d69f47583258e541602df0495709"} Aug 04 18:01:46.583787 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:46.583740 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-42kq7" podStartSLOduration=65.597680842 podStartE2EDuration="1m7.583722725s" totalImagesPullingTime="1.986041883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:46.583087652 +0000 UTC m=+102.886031578" watchObservedRunningTime="2026-08-04 18:01:46.583722725 +0000 UTC m=+102.886666649" Aug 04 18:01:47.556547 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:47.556498 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-42kq7" Aug 04 18:01:49.057661 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.057634 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77c79df868-dp7pg"] Aug 04 18:01:49.088346 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.088321 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c79df868-dp7pg"] Aug 04 18:01:49.088513 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.088409 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.091309 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.091288 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 04 18:01:49.091537 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.091521 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-68557\"" Aug 04 18:01:49.091608 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.091592 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 04 18:01:49.092248 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.092229 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 04 18:01:49.092343 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.092235 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 04 18:01:49.092561 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.092544 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 04 18:01:49.092669 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.092567 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 04 18:01:49.092741 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.092697 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 04 18:01:49.100307 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.100284 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Aug 04 18:01:49.124437 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.124411 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:01:49.242863 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.242829 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-trusted-ca-bundle\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.242863 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.242865 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-service-ca\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.243079 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.242885 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-oauth-config\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.243079 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.242911 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx2fj\" (UniqueName: \"kubernetes.io/projected/32011f25-09dc-4925-acbe-8a5633293e85-kube-api-access-jx2fj\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.243079 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.242963 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-serving-cert\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.243079 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.243053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-console-config\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.243079 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.243072 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-oauth-serving-cert\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.344339 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.344275 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx2fj\" (UniqueName: \"kubernetes.io/projected/32011f25-09dc-4925-acbe-8a5633293e85-kube-api-access-jx2fj\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.344339 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.344313 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-serving-cert\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.344472 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.344356 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-console-config\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.344472 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.344370 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-oauth-serving-cert\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.344472 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.344392 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-trusted-ca-bundle\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.344472 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.344408 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-service-ca\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.344472 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.344425 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-oauth-config\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.345232 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.345205 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-service-ca\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.345337 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.345205 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-oauth-serving-cert\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.345337 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.345294 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-trusted-ca-bundle\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.345435 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.345340 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-console-config\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.346716 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.346692 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-oauth-config\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.346871 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.346854 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-serving-cert\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.353916 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.353896 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx2fj\" (UniqueName: \"kubernetes.io/projected/32011f25-09dc-4925-acbe-8a5633293e85-kube-api-access-jx2fj\") pod \"console-77c79df868-dp7pg\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.398793 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.398769 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:49.571617 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:49.571561 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c79df868-dp7pg"] Aug 04 18:01:49.573606 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:01:49.573577 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32011f25_09dc_4925_acbe_8a5633293e85.slice/crio-abcd27da6face5f6d556ffa96353074ad2b30d03dd9f12af24afe01732e2f9d8 WatchSource:0}: Error finding container abcd27da6face5f6d556ffa96353074ad2b30d03dd9f12af24afe01732e2f9d8: Status 404 returned error can't find the container with id abcd27da6face5f6d556ffa96353074ad2b30d03dd9f12af24afe01732e2f9d8 Aug 04 18:01:50.567817 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:50.567786 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c79df868-dp7pg" event={"ID":"32011f25-09dc-4925-acbe-8a5633293e85","Type":"ContainerStarted","Data":"abcd27da6face5f6d556ffa96353074ad2b30d03dd9f12af24afe01732e2f9d8"} Aug 04 18:01:52.575743 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:52.575652 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c79df868-dp7pg" event={"ID":"32011f25-09dc-4925-acbe-8a5633293e85","Type":"ContainerStarted","Data":"aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34"} Aug 04 18:01:52.598112 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:52.598064 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77c79df868-dp7pg" podStartSLOduration=0.86571284 podStartE2EDuration="3.598048897s" totalImagesPullingTime="2.732336057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:01:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:01:52.596577049 +0000 UTC m=+108.899520987" watchObservedRunningTime="2026-08-04 18:01:52.598048897 +0000 UTC m=+108.900992824" Aug 04 18:01:57.562035 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:57.562002 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-42kq7" Aug 04 18:01:59.399589 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:59.399557 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:59.400046 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:59.399625 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:59.404204 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:59.404182 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:01:59.601371 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:01:59.601346 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:02:01.533284 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:01.533251 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f79dc8896-zvsv9" Aug 04 18:02:02.609006 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:02.608984 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:02:02.609366 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:02.609028 2583 generic.go:356] "Generic (PLEG): container finished" podID="74907d13-f21b-42d4-bbb3-7707a76b3163" containerID="8f2753a3951987a66d0bbb322f5c9ea962f6f997944c52189f578efb6bdb799d" exitCode=2 Aug 04 18:02:02.609366 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:02.609075 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" event={"ID":"74907d13-f21b-42d4-bbb3-7707a76b3163","Type":"ContainerDied","Data":"8f2753a3951987a66d0bbb322f5c9ea962f6f997944c52189f578efb6bdb799d"} Aug 04 18:02:02.609450 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:02.609408 2583 scope.go:117] "RemoveContainer" containerID="8f2753a3951987a66d0bbb322f5c9ea962f6f997944c52189f578efb6bdb799d" Aug 04 18:02:03.613931 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:03.613901 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:02:03.614328 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:03.614002 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-cq46m" event={"ID":"74907d13-f21b-42d4-bbb3-7707a76b3163","Type":"ContainerStarted","Data":"79a5546ccf50bb4ec68f42baa4abdfcab76c9ce9d708f8a497a0a378f65e5533"} Aug 04 18:02:04.138073 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.138037 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" podUID="7201b21b-5fc5-4ecc-93dd-7f0188e7339f" containerName="registry" containerID="cri-o://e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965" gracePeriod=30 Aug 04 18:02:04.373584 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.373559 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:02:04.464963 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.464875 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-installation-pull-secrets\") pod \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " Aug 04 18:02:04.464963 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.464916 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7596d\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-kube-api-access-7596d\") pod \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " Aug 04 18:02:04.464963 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.464946 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") pod \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " Aug 04 18:02:04.464963 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.464966 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-ca-trust-extracted\") pod \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " Aug 04 18:02:04.465214 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.465076 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-trusted-ca\") pod \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " Aug 04 18:02:04.465214 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.465114 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-certificates\") pod \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " Aug 04 18:02:04.465214 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.465143 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-bound-sa-token\") pod \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " Aug 04 18:02:04.465214 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.465177 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-image-registry-private-configuration\") pod \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\" (UID: \"7201b21b-5fc5-4ecc-93dd-7f0188e7339f\") " Aug 04 18:02:04.465730 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.465665 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7201b21b-5fc5-4ecc-93dd-7f0188e7339f" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:02:04.465842 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.465789 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7201b21b-5fc5-4ecc-93dd-7f0188e7339f" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:02:04.467590 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.467557 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7201b21b-5fc5-4ecc-93dd-7f0188e7339f" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:02:04.467746 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.467705 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-kube-api-access-7596d" (OuterVolumeSpecName: "kube-api-access-7596d") pod "7201b21b-5fc5-4ecc-93dd-7f0188e7339f" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f"). InnerVolumeSpecName "kube-api-access-7596d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 18:02:04.467821 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.467761 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7201b21b-5fc5-4ecc-93dd-7f0188e7339f" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:02:04.467821 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.467768 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7201b21b-5fc5-4ecc-93dd-7f0188e7339f" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 18:02:04.467894 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.467873 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7201b21b-5fc5-4ecc-93dd-7f0188e7339f" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 18:02:04.473189 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.473165 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7201b21b-5fc5-4ecc-93dd-7f0188e7339f" (UID: "7201b21b-5fc5-4ecc-93dd-7f0188e7339f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 04 18:02:04.566527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.566473 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-bound-sa-token\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:04.566527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.566525 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-image-registry-private-configuration\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:04.566527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.566537 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-installation-pull-secrets\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:04.566746 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.566547 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7596d\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-kube-api-access-7596d\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:04.566746 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.566556 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-tls\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:04.566746 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.566564 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-ca-trust-extracted\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:04.566746 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.566572 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-trusted-ca\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:04.566746 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.566580 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7201b21b-5fc5-4ecc-93dd-7f0188e7339f-registry-certificates\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:04.618839 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.618803 2583 generic.go:356] "Generic (PLEG): container finished" podID="7201b21b-5fc5-4ecc-93dd-7f0188e7339f" containerID="e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965" exitCode=0 Aug 04 18:02:04.619293 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.618852 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" event={"ID":"7201b21b-5fc5-4ecc-93dd-7f0188e7339f","Type":"ContainerDied","Data":"e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965"} Aug 04 18:02:04.619293 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.618858 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" Aug 04 18:02:04.619293 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.618891 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cd9c7fccf-j94rd" event={"ID":"7201b21b-5fc5-4ecc-93dd-7f0188e7339f","Type":"ContainerDied","Data":"9de56c66f54ea143463e92c1805dd09151b5da952f4de44b26ca0d2b17443c21"} Aug 04 18:02:04.619293 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.618910 2583 scope.go:117] "RemoveContainer" containerID="e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965" Aug 04 18:02:04.627431 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.627413 2583 scope.go:117] "RemoveContainer" containerID="e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965" Aug 04 18:02:04.627739 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:04.627719 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965\": container with ID starting with e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965 not found: ID does not exist" containerID="e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965" Aug 04 18:02:04.627784 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.627748 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965"} err="failed to get container status \"e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965\": rpc error: code = NotFound desc = could not find container \"e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965\": container with ID starting with e277d16995424be5ea1478870f930d894e168cd4a5747e81bdf007d2e7717965 not found: ID does not exist" Aug 04 18:02:04.653876 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.653842 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cd9c7fccf-j94rd"] Aug 04 18:02:04.658383 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:04.658359 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cd9c7fccf-j94rd"] Aug 04 18:02:06.154135 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.154102 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7201b21b-5fc5-4ecc-93dd-7f0188e7339f" path="/var/lib/kubelet/pods/7201b21b-5fc5-4ecc-93dd-7f0188e7339f/volumes" Aug 04 18:02:06.395587 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.395549 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp"] Aug 04 18:02:06.396059 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.395882 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7201b21b-5fc5-4ecc-93dd-7f0188e7339f" containerName="registry" Aug 04 18:02:06.396059 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.395899 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7201b21b-5fc5-4ecc-93dd-7f0188e7339f" containerName="registry" Aug 04 18:02:06.396059 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.395955 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7201b21b-5fc5-4ecc-93dd-7f0188e7339f" containerName="registry" Aug 04 18:02:06.400778 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.400758 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.404842 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.404790 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Aug 04 18:02:06.404936 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.404879 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2pksq\"" Aug 04 18:02:06.405175 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.405129 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Aug 04 18:02:06.406059 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.406040 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 04 18:02:06.414064 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.414021 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp"] Aug 04 18:02:06.469762 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.469726 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fg4zb"] Aug 04 18:02:06.473301 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.473282 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.478359 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.478331 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 04 18:02:06.479290 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:06.479266 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-128-51.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-51.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Aug 04 18:02:06.479368 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:06.479266 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-128-51.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-51.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" Aug 04 18:02:06.480851 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.480798 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.480932 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.480871 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.480932 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.480915 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.481038 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.481020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99kgg\" (UniqueName: \"kubernetes.io/projected/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-kube-api-access-99kgg\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.483827 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:06.483796 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-fg4zb\" is forbidden: User \"system:node:ip-10-0-128-51.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-128-51.ec2.internal' and this object" podUID="30f0604d-7979-4432-b522-c5165050853b" pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.484036 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.484024 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6dtkz\"" Aug 04 18:02:06.581938 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.581906 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30f0604d-7979-4432-b522-c5165050853b-sys\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.582131 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.581958 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30f0604d-7979-4432-b522-c5165050853b-node-exporter-wtmp\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.582131 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582042 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99kgg\" (UniqueName: \"kubernetes.io/projected/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-kube-api-access-99kgg\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.582131 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582083 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.582131 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582106 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.582353 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582136 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30f0604d-7979-4432-b522-c5165050853b-node-exporter-textfile\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.582353 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582159 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30f0604d-7979-4432-b522-c5165050853b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.582353 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582194 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30f0604d-7979-4432-b522-c5165050853b-root\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.582353 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582222 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.582353 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582275 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30f0604d-7979-4432-b522-c5165050853b-node-exporter-tls\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.582353 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582316 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30f0604d-7979-4432-b522-c5165050853b-node-exporter-accelerators-collector-config\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.582671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582369 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f0604d-7979-4432-b522-c5165050853b-metrics-client-ca\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.582671 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582413 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8ps6\" (UniqueName: \"kubernetes.io/projected/30f0604d-7979-4432-b522-c5165050853b-kube-api-access-s8ps6\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.582671 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:06.582480 2583 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Aug 04 18:02:06.582671 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:06.582560 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-openshift-state-metrics-tls podName:9e16d20a-4350-4a9c-93b2-fd095fb9aa97 nodeName:}" failed. No retries permitted until 2026-08-04 18:02:07.08253997 +0000 UTC m=+123.385483876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-g6zzp" (UID: "9e16d20a-4350-4a9c-93b2-fd095fb9aa97") : secret "openshift-state-metrics-tls" not found Aug 04 18:02:06.582941 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.582920 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.584861 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.584842 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.596947 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.596922 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99kgg\" (UniqueName: \"kubernetes.io/projected/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-kube-api-access-99kgg\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:06.683619 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683534 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30f0604d-7979-4432-b522-c5165050853b-sys\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683619 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683578 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30f0604d-7979-4432-b522-c5165050853b-node-exporter-wtmp\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683859 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683634 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30f0604d-7979-4432-b522-c5165050853b-node-exporter-textfile\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683859 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683651 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30f0604d-7979-4432-b522-c5165050853b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683859 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683648 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30f0604d-7979-4432-b522-c5165050853b-sys\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683859 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683677 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30f0604d-7979-4432-b522-c5165050853b-root\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683859 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683718 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30f0604d-7979-4432-b522-c5165050853b-node-exporter-tls\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683859 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683755 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30f0604d-7979-4432-b522-c5165050853b-node-exporter-accelerators-collector-config\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683859 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683783 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30f0604d-7979-4432-b522-c5165050853b-node-exporter-wtmp\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683859 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683797 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30f0604d-7979-4432-b522-c5165050853b-root\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.683859 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683800 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f0604d-7979-4432-b522-c5165050853b-metrics-client-ca\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.684283 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683925 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8ps6\" (UniqueName: \"kubernetes.io/projected/30f0604d-7979-4432-b522-c5165050853b-kube-api-access-s8ps6\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.684283 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.683992 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30f0604d-7979-4432-b522-c5165050853b-node-exporter-textfile\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.684516 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.684480 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30f0604d-7979-4432-b522-c5165050853b-metrics-client-ca\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.685978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.685959 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30f0604d-7979-4432-b522-c5165050853b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:06.693875 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:06.693853 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8ps6\" (UniqueName: \"kubernetes.io/projected/30f0604d-7979-4432-b522-c5165050853b-kube-api-access-s8ps6\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:07.086467 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.086390 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:07.088620 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.088595 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9e16d20a-4350-4a9c-93b2-fd095fb9aa97-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-g6zzp\" (UID: \"9e16d20a-4350-4a9c-93b2-fd095fb9aa97\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:07.310131 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.310102 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" Aug 04 18:02:07.417084 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.417054 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 04 18:02:07.425003 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.424978 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30f0604d-7979-4432-b522-c5165050853b-node-exporter-accelerators-collector-config\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:07.455920 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.455896 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp"] Aug 04 18:02:07.458683 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:02:07.458655 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e16d20a_4350_4a9c_93b2_fd095fb9aa97.slice/crio-4468bea7030c0a0b5719965071e5d39e00ed2794b6590670e2f3a596065d900e WatchSource:0}: Error finding container 4468bea7030c0a0b5719965071e5d39e00ed2794b6590670e2f3a596065d900e: Status 404 returned error can't find the container with id 4468bea7030c0a0b5719965071e5d39e00ed2794b6590670e2f3a596065d900e Aug 04 18:02:07.482361 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.482339 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 04 18:02:07.486056 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.485792 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.491737 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.491720 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Aug 04 18:02:07.493588 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.493569 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Aug 04 18:02:07.493910 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.493783 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Aug 04 18:02:07.493910 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.493791 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Aug 04 18:02:07.494072 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.494053 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Aug 04 18:02:07.494380 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.494366 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Aug 04 18:02:07.494916 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.494901 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Aug 04 18:02:07.495038 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.494968 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Aug 04 18:02:07.495103 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.494970 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ls9ck\"" Aug 04 18:02:07.496069 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.496049 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Aug 04 18:02:07.523065 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.523041 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 04 18:02:07.591202 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591171 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591322 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591208 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591322 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591238 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/df60301f-42f3-49b6-9b5f-586a36520202-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591322 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591280 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591321 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt7qv\" (UniqueName: \"kubernetes.io/projected/df60301f-42f3-49b6-9b5f-586a36520202-kube-api-access-vt7qv\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591379 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df60301f-42f3-49b6-9b5f-586a36520202-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591403 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df60301f-42f3-49b6-9b5f-586a36520202-config-out\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591420 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-config-volume\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591473 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df60301f-42f3-49b6-9b5f-586a36520202-tls-assets\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591784 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591490 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591784 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591527 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-web-config\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.591784 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.591551 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df60301f-42f3-49b6-9b5f-586a36520202-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.634137 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.634063 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" event={"ID":"9e16d20a-4350-4a9c-93b2-fd095fb9aa97","Type":"ContainerStarted","Data":"7d73747e42938633fec73f9cf79cfa9ffd2707f6013cabc965b685d52bfd804f"} Aug 04 18:02:07.634137 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.634118 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" event={"ID":"9e16d20a-4350-4a9c-93b2-fd095fb9aa97","Type":"ContainerStarted","Data":"5a1bfc4abebb68bc8f1f849278e0587416600048fe4844a967d95a8b0bca4fff"} Aug 04 18:02:07.634137 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.634137 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" event={"ID":"9e16d20a-4350-4a9c-93b2-fd095fb9aa97","Type":"ContainerStarted","Data":"4468bea7030c0a0b5719965071e5d39e00ed2794b6590670e2f3a596065d900e"} Aug 04 18:02:07.684419 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:07.684386 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: failed to sync secret cache: timed out waiting for the condition Aug 04 18:02:07.684599 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:07.684483 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30f0604d-7979-4432-b522-c5165050853b-node-exporter-tls podName:30f0604d-7979-4432-b522-c5165050853b nodeName:}" failed. No retries permitted until 2026-08-04 18:02:08.18446566 +0000 UTC m=+124.487409581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/30f0604d-7979-4432-b522-c5165050853b-node-exporter-tls") pod "node-exporter-fg4zb" (UID: "30f0604d-7979-4432-b522-c5165050853b") : failed to sync secret cache: timed out waiting for the condition Aug 04 18:02:07.692843 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.692818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df60301f-42f3-49b6-9b5f-586a36520202-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.692923 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.692860 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df60301f-42f3-49b6-9b5f-586a36520202-config-out\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.692923 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.692886 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.692923 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.692913 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-config-volume\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.693066 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.692935 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df60301f-42f3-49b6-9b5f-586a36520202-tls-assets\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.693066 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.692963 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.693066 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.692991 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-web-config\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.693066 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.693048 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df60301f-42f3-49b6-9b5f-586a36520202-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.693253 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.693117 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.693253 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.693178 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.693253 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.693224 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/df60301f-42f3-49b6-9b5f-586a36520202-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.693395 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.693270 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.693395 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.693374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt7qv\" (UniqueName: \"kubernetes.io/projected/df60301f-42f3-49b6-9b5f-586a36520202-kube-api-access-vt7qv\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.694356 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.693754 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df60301f-42f3-49b6-9b5f-586a36520202-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.694356 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:07.693757 2583 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Aug 04 18:02:07.694356 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:07.693845 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-main-tls podName:df60301f-42f3-49b6-9b5f-586a36520202 nodeName:}" failed. No retries permitted until 2026-08-04 18:02:08.193825872 +0000 UTC m=+124.496769776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "df60301f-42f3-49b6-9b5f-586a36520202") : secret "alertmanager-main-tls" not found Aug 04 18:02:07.694356 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.694043 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/df60301f-42f3-49b6-9b5f-586a36520202-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.694356 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:07.694140 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/df60301f-42f3-49b6-9b5f-586a36520202-alertmanager-trusted-ca-bundle podName:df60301f-42f3-49b6-9b5f-586a36520202 nodeName:}" failed. No retries permitted until 2026-08-04 18:02:08.194124489 +0000 UTC m=+124.497068402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/df60301f-42f3-49b6-9b5f-586a36520202-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "df60301f-42f3-49b6-9b5f-586a36520202") : configmap references non-existent config key: ca-bundle.crt Aug 04 18:02:07.696186 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.696159 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-config-volume\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.696999 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.696974 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.697104 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.697046 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.697186 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.697157 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.697422 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.697402 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/df60301f-42f3-49b6-9b5f-586a36520202-config-out\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.697594 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.697574 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.698043 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.698022 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/df60301f-42f3-49b6-9b5f-586a36520202-tls-assets\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.698379 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.698361 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-web-config\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.708749 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.708728 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt7qv\" (UniqueName: \"kubernetes.io/projected/df60301f-42f3-49b6-9b5f-586a36520202-kube-api-access-vt7qv\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:07.891189 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:07.891109 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 04 18:02:08.198138 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.198056 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:08.198322 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.198136 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30f0604d-7979-4432-b522-c5165050853b-node-exporter-tls\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:08.198322 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.198193 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df60301f-42f3-49b6-9b5f-586a36520202-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:08.199249 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.199225 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df60301f-42f3-49b6-9b5f-586a36520202-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:08.200712 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.200686 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30f0604d-7979-4432-b522-c5165050853b-node-exporter-tls\") pod \"node-exporter-fg4zb\" (UID: \"30f0604d-7979-4432-b522-c5165050853b\") " pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:08.200878 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.200859 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/df60301f-42f3-49b6-9b5f-586a36520202-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"df60301f-42f3-49b6-9b5f-586a36520202\") " pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:08.284515 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.284469 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fg4zb" Aug 04 18:02:08.377072 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.377036 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-744877fb47-hdnzh"] Aug 04 18:02:08.380191 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.380172 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.382737 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.382716 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Aug 04 18:02:08.383282 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.383267 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-grmqv\"" Aug 04 18:02:08.383651 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.383621 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Aug 04 18:02:08.383876 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.383857 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eno92equpa5g6\"" Aug 04 18:02:08.385425 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.385406 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Aug 04 18:02:08.386496 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.386476 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Aug 04 18:02:08.386595 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.386478 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Aug 04 18:02:08.401294 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.401206 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-744877fb47-hdnzh"] Aug 04 18:02:08.409201 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.409174 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 04 18:02:08.415467 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:02:08.415442 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f0604d_7979_4432_b522_c5165050853b.slice/crio-dc6a25c61bbd129b71ff320642191dd8a76cda7600ed6478efea492e2269ac19 WatchSource:0}: Error finding container dc6a25c61bbd129b71ff320642191dd8a76cda7600ed6478efea492e2269ac19: Status 404 returned error can't find the container with id dc6a25c61bbd129b71ff320642191dd8a76cda7600ed6478efea492e2269ac19 Aug 04 18:02:08.501614 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.501585 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-tls\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.501738 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.501626 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.501738 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.501710 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.501816 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.501764 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-grpc-tls\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.501849 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.501820 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.501849 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.501844 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ebf936c-9776-4ee9-9e09-007659ac3fd3-metrics-client-ca\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.501927 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.501871 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.501965 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.501913 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgw2w\" (UniqueName: \"kubernetes.io/projected/6ebf936c-9776-4ee9-9e09-007659ac3fd3-kube-api-access-bgw2w\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.558205 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.558167 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 04 18:02:08.561424 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:02:08.561399 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf60301f_42f3_49b6_9b5f_586a36520202.slice/crio-708d431d66e4347417cb61ca87f8b4433ebc96c1822f6462e1b0c54819476e01 WatchSource:0}: Error finding container 708d431d66e4347417cb61ca87f8b4433ebc96c1822f6462e1b0c54819476e01: Status 404 returned error can't find the container with id 708d431d66e4347417cb61ca87f8b4433ebc96c1822f6462e1b0c54819476e01 Aug 04 18:02:08.602767 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.602736 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-grpc-tls\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.602905 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.602791 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.602905 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.602812 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ebf936c-9776-4ee9-9e09-007659ac3fd3-metrics-client-ca\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.602905 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.602835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.602905 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.602852 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgw2w\" (UniqueName: \"kubernetes.io/projected/6ebf936c-9776-4ee9-9e09-007659ac3fd3-kube-api-access-bgw2w\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.602905 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.602891 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-tls\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.603156 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.602914 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.603156 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.602968 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.603731 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.603670 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ebf936c-9776-4ee9-9e09-007659ac3fd3-metrics-client-ca\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.605599 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.605572 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.605726 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.605684 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-tls\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.605797 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.605745 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.605851 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.605796 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.605851 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.605841 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.605929 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.605922 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ebf936c-9776-4ee9-9e09-007659ac3fd3-secret-grpc-tls\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.612178 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.612161 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgw2w\" (UniqueName: \"kubernetes.io/projected/6ebf936c-9776-4ee9-9e09-007659ac3fd3-kube-api-access-bgw2w\") pod \"thanos-querier-744877fb47-hdnzh\" (UID: \"6ebf936c-9776-4ee9-9e09-007659ac3fd3\") " pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.639617 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.639589 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" event={"ID":"9e16d20a-4350-4a9c-93b2-fd095fb9aa97","Type":"ContainerStarted","Data":"78ae9aa0b225f8090f47878e65958a87dfdcb3fbf23cf8d8a3d35d2e8b768bab"} Aug 04 18:02:08.640857 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.640835 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df60301f-42f3-49b6-9b5f-586a36520202","Type":"ContainerStarted","Data":"708d431d66e4347417cb61ca87f8b4433ebc96c1822f6462e1b0c54819476e01"} Aug 04 18:02:08.641873 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.641855 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fg4zb" event={"ID":"30f0604d-7979-4432-b522-c5165050853b","Type":"ContainerStarted","Data":"dc6a25c61bbd129b71ff320642191dd8a76cda7600ed6478efea492e2269ac19"} Aug 04 18:02:08.664738 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.664692 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-g6zzp" podStartSLOduration=1.825987866 podStartE2EDuration="2.66467833s" totalImagesPullingTime="838.690464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:08.663486343 +0000 UTC m=+124.966430293" watchObservedRunningTime="2026-08-04 18:02:08.66467833 +0000 UTC m=+124.967622254" Aug 04 18:02:08.691590 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.691567 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:08.822424 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:08.822298 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-744877fb47-hdnzh"] Aug 04 18:02:08.824823 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:02:08.824796 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ebf936c_9776_4ee9_9e09_007659ac3fd3.slice/crio-02fb1c21b187ca018bcc603f436a650f33c28475d53cfb0811df75b88d6bf21b WatchSource:0}: Error finding container 02fb1c21b187ca018bcc603f436a650f33c28475d53cfb0811df75b88d6bf21b: Status 404 returned error can't find the container with id 02fb1c21b187ca018bcc603f436a650f33c28475d53cfb0811df75b88d6bf21b Aug 04 18:02:09.648255 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:09.648218 2583 generic.go:356] "Generic (PLEG): container finished" podID="df60301f-42f3-49b6-9b5f-586a36520202" containerID="5e6c11301abadcdcd45ecac0d1ada1ffc0faa35d9b2325050aef887c8920ad39" exitCode=0 Aug 04 18:02:09.648682 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:09.648296 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df60301f-42f3-49b6-9b5f-586a36520202","Type":"ContainerDied","Data":"5e6c11301abadcdcd45ecac0d1ada1ffc0faa35d9b2325050aef887c8920ad39"} Aug 04 18:02:09.650227 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:09.650194 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fg4zb" event={"ID":"30f0604d-7979-4432-b522-c5165050853b","Type":"ContainerStarted","Data":"dcc6ebfb93b9590d5a2eba58acf41151960f8a11df3fa3735025c5f0aef4a4bb"} Aug 04 18:02:09.651616 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:09.651592 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" event={"ID":"6ebf936c-9776-4ee9-9e09-007659ac3fd3","Type":"ContainerStarted","Data":"02fb1c21b187ca018bcc603f436a650f33c28475d53cfb0811df75b88d6bf21b"} Aug 04 18:02:10.659140 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:10.659016 2583 generic.go:356] "Generic (PLEG): container finished" podID="30f0604d-7979-4432-b522-c5165050853b" containerID="dcc6ebfb93b9590d5a2eba58acf41151960f8a11df3fa3735025c5f0aef4a4bb" exitCode=0 Aug 04 18:02:10.659140 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:10.659105 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fg4zb" event={"ID":"30f0604d-7979-4432-b522-c5165050853b","Type":"ContainerDied","Data":"dcc6ebfb93b9590d5a2eba58acf41151960f8a11df3fa3735025c5f0aef4a4bb"} Aug 04 18:02:11.173121 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.173074 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf"] Aug 04 18:02:11.175436 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.175411 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:11.179211 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.179183 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Aug 04 18:02:11.180106 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.180083 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zhmr5\"" Aug 04 18:02:11.205246 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.205216 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf"] Aug 04 18:02:11.229289 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.229260 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-tp6qf\" (UID: \"5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:11.229289 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.229294 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgmfz\" (UniqueName: \"kubernetes.io/projected/5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6-kube-api-access-qgmfz\") pod \"monitoring-plugin-6dffbbd67-tp6qf\" (UID: \"5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:11.330681 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.330647 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-tp6qf\" (UID: \"5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:11.330879 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.330700 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgmfz\" (UniqueName: \"kubernetes.io/projected/5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6-kube-api-access-qgmfz\") pod \"monitoring-plugin-6dffbbd67-tp6qf\" (UID: \"5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:11.333457 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.333427 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-tp6qf\" (UID: \"5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:11.344430 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.344407 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgmfz\" (UniqueName: \"kubernetes.io/projected/5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6-kube-api-access-qgmfz\") pod \"monitoring-plugin-6dffbbd67-tp6qf\" (UID: \"5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:11.486847 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.486756 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:11.667194 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.667158 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fg4zb" event={"ID":"30f0604d-7979-4432-b522-c5165050853b","Type":"ContainerStarted","Data":"e703d1c7d448ad9843790b01cd91b12e320cbc7d2bfddea19b9344f423c1ab01"} Aug 04 18:02:11.667660 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.667217 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fg4zb" event={"ID":"30f0604d-7979-4432-b522-c5165050853b","Type":"ContainerStarted","Data":"bd4d5f3e1d8dd47bd7a817e9c2f4ef6497c0eda60d1c4c57a5658b941683c3b2"} Aug 04 18:02:11.700987 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.700942 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fg4zb" podStartSLOduration=4.51675583 podStartE2EDuration="5.700925978s" totalImagesPullingTime="1.112070971s" totalInitContainerRuntime="72.099177ms" isStatefulPod=true podCreationTimestamp="2026-08-04 18:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:11.700037887 +0000 UTC m=+128.002981814" watchObservedRunningTime="2026-08-04 18:02:11.700925978 +0000 UTC m=+128.003869902" Aug 04 18:02:11.815032 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.814757 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-78c4cb6c88-9gsll"] Aug 04 18:02:11.817451 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.817433 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:11.821023 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.820822 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Aug 04 18:02:11.823484 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.823350 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Aug 04 18:02:11.823484 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.823456 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Aug 04 18:02:11.823651 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.823632 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Aug 04 18:02:11.825912 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.825891 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2j87h\"" Aug 04 18:02:11.845139 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.844736 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Aug 04 18:02:11.852981 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.852919 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Aug 04 18:02:11.864134 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.864107 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78c4cb6c88-9gsll"] Aug 04 18:02:11.909830 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.909730 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf"] Aug 04 18:02:11.921098 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:02:11.921072 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3fc7b1_af98_46d3_b1ef_4ccba5fa5cf6.slice/crio-d0f4a34d7db546d3cf6350656dbfccd28b2c4021100b75168c90b5346a1d9390 WatchSource:0}: Error finding container d0f4a34d7db546d3cf6350656dbfccd28b2c4021100b75168c90b5346a1d9390: Status 404 returned error can't find the container with id d0f4a34d7db546d3cf6350656dbfccd28b2c4021100b75168c90b5346a1d9390 Aug 04 18:02:11.941368 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.940918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8c29ddf-7656-4e28-8005-c38739080a89-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:11.941368 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.940985 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8c29ddf-7656-4e28-8005-c38739080a89-metrics-client-ca\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:11.941368 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.941026 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-telemeter-client-tls\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:11.941368 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.941057 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:11.941368 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.941092 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-secret-telemeter-client\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:11.941368 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.941126 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xljqz\" (UniqueName: \"kubernetes.io/projected/a8c29ddf-7656-4e28-8005-c38739080a89-kube-api-access-xljqz\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:11.941368 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.941159 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8c29ddf-7656-4e28-8005-c38739080a89-serving-certs-ca-bundle\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:11.941368 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:11.941239 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-federate-client-tls\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.042277 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.042245 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-federate-client-tls\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.042359 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.042302 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8c29ddf-7656-4e28-8005-c38739080a89-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.042359 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.042350 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8c29ddf-7656-4e28-8005-c38739080a89-metrics-client-ca\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.042468 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.042393 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-telemeter-client-tls\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.042468 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.042425 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.042468 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.042463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-secret-telemeter-client\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.042710 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.042527 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xljqz\" (UniqueName: \"kubernetes.io/projected/a8c29ddf-7656-4e28-8005-c38739080a89-kube-api-access-xljqz\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.042710 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.042566 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8c29ddf-7656-4e28-8005-c38739080a89-serving-certs-ca-bundle\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.043172 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.043113 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8c29ddf-7656-4e28-8005-c38739080a89-metrics-client-ca\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.043541 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.043468 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8c29ddf-7656-4e28-8005-c38739080a89-telemeter-trusted-ca-bundle\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.043968 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.043914 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8c29ddf-7656-4e28-8005-c38739080a89-serving-certs-ca-bundle\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.044998 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.044977 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-federate-client-tls\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.045193 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.045174 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.045773 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.045753 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-secret-telemeter-client\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.046195 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.046176 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a8c29ddf-7656-4e28-8005-c38739080a89-telemeter-client-tls\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.070867 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.070839 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xljqz\" (UniqueName: \"kubernetes.io/projected/a8c29ddf-7656-4e28-8005-c38739080a89-kube-api-access-xljqz\") pod \"telemeter-client-78c4cb6c88-9gsll\" (UID: \"a8c29ddf-7656-4e28-8005-c38739080a89\") " pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.134971 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.134943 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" Aug 04 18:02:12.272273 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.272199 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-78c4cb6c88-9gsll"] Aug 04 18:02:12.275437 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:02:12.275411 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c29ddf_7656_4e28_8005_c38739080a89.slice/crio-637f04f454ba6b38e9312a6ed430e3b1f28b280652f5c609efbfa7874fede1c9 WatchSource:0}: Error finding container 637f04f454ba6b38e9312a6ed430e3b1f28b280652f5c609efbfa7874fede1c9: Status 404 returned error can't find the container with id 637f04f454ba6b38e9312a6ed430e3b1f28b280652f5c609efbfa7874fede1c9 Aug 04 18:02:12.677195 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.677159 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df60301f-42f3-49b6-9b5f-586a36520202","Type":"ContainerStarted","Data":"2708e9e493637f1706222c6756b4fdc77896c9ff5c0a9e84a5e12ee2fef167bb"} Aug 04 18:02:12.677673 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.677242 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df60301f-42f3-49b6-9b5f-586a36520202","Type":"ContainerStarted","Data":"735fe13077f5d2035e4d6b5c38a67dc569e9b6bfcdd23f8af03cfee875c9c4ce"} Aug 04 18:02:12.677673 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.677284 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df60301f-42f3-49b6-9b5f-586a36520202","Type":"ContainerStarted","Data":"57885eb4e03e96570782f92071f3cbdcf629d558198bba5e03c6682ea81f7f36"} Aug 04 18:02:12.677673 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.677323 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df60301f-42f3-49b6-9b5f-586a36520202","Type":"ContainerStarted","Data":"69c964d6aaa05ee76f835738b4fa3f4f440eb23113d52920a63d544db5885202"} Aug 04 18:02:12.677673 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.677349 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df60301f-42f3-49b6-9b5f-586a36520202","Type":"ContainerStarted","Data":"6b74bf232db87a86c15079e5b63c0e2a295dbbf6ceb7a496bbf927323d52d6cf"} Aug 04 18:02:12.678496 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.678412 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" event={"ID":"5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6","Type":"ContainerStarted","Data":"d0f4a34d7db546d3cf6350656dbfccd28b2c4021100b75168c90b5346a1d9390"} Aug 04 18:02:12.680980 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.680955 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" event={"ID":"6ebf936c-9776-4ee9-9e09-007659ac3fd3","Type":"ContainerStarted","Data":"0973f533e06fdcf291e724c29a7b625bb5fa4d6210db43a5ee30e7cbb4dde23c"} Aug 04 18:02:12.681080 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.681026 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" event={"ID":"6ebf936c-9776-4ee9-9e09-007659ac3fd3","Type":"ContainerStarted","Data":"a51106196a047189f1639cfd00b7512bd37b19accff02b11018179ba7ea5bb7a"} Aug 04 18:02:12.681080 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.681071 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" event={"ID":"6ebf936c-9776-4ee9-9e09-007659ac3fd3","Type":"ContainerStarted","Data":"5e419a59f6ee90c91e5c3a376e30e70e3d5487ae38ce0bce46dd47793c4ee675"} Aug 04 18:02:12.682584 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:12.682558 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" event={"ID":"a8c29ddf-7656-4e28-8005-c38739080a89","Type":"ContainerStarted","Data":"637f04f454ba6b38e9312a6ed430e3b1f28b280652f5c609efbfa7874fede1c9"} Aug 04 18:02:13.961916 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:13.961826 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:02:13.964102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:13.964079 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/349d54df-5bd2-4a3f-8d94-25c6ec118a46-metrics-certs\") pod \"network-metrics-daemon-5brj6\" (UID: \"349d54df-5bd2-4a3f-8d94-25c6ec118a46\") " pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:02:14.191653 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.191628 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hp4qc\"" Aug 04 18:02:14.199393 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.199373 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5brj6" Aug 04 18:02:14.355651 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.355625 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5brj6"] Aug 04 18:02:14.358287 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:02:14.358257 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod349d54df_5bd2_4a3f_8d94_25c6ec118a46.slice/crio-0d1310d8b7ff50968430052acbfa1efa495ea57eedb5010e358cdd6c39bc7c80 WatchSource:0}: Error finding container 0d1310d8b7ff50968430052acbfa1efa495ea57eedb5010e358cdd6c39bc7c80: Status 404 returned error can't find the container with id 0d1310d8b7ff50968430052acbfa1efa495ea57eedb5010e358cdd6c39bc7c80 Aug 04 18:02:14.695609 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.695574 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" event={"ID":"6ebf936c-9776-4ee9-9e09-007659ac3fd3","Type":"ContainerStarted","Data":"de44a0901262a091fd0ac41b27d4cffab88582e9ca276c3ec25b5079aaa17c7b"} Aug 04 18:02:14.695802 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.695654 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" event={"ID":"6ebf936c-9776-4ee9-9e09-007659ac3fd3","Type":"ContainerStarted","Data":"7197d4cf190f236dea5d19d48a1246bd269c2bd5b3ab6ecb995e2da509fab19d"} Aug 04 18:02:14.695802 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.695696 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" event={"ID":"6ebf936c-9776-4ee9-9e09-007659ac3fd3","Type":"ContainerStarted","Data":"188c519187014e3f538ba6afe488d343e76517c9d31ae415af71abf1db3dce01"} Aug 04 18:02:14.695802 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.695755 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:14.696802 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.696780 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5brj6" event={"ID":"349d54df-5bd2-4a3f-8d94-25c6ec118a46","Type":"ContainerStarted","Data":"0d1310d8b7ff50968430052acbfa1efa495ea57eedb5010e358cdd6c39bc7c80"} Aug 04 18:02:14.699712 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.699687 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"df60301f-42f3-49b6-9b5f-586a36520202","Type":"ContainerStarted","Data":"bcc28436078622c1f0b58fc2fdd629bd354633272d9ee768e82e75d2610e5d3f"} Aug 04 18:02:14.701222 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.701203 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" event={"ID":"5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6","Type":"ContainerStarted","Data":"daa49a186080dd86c27aa002734de16500aced1b5ce582840ac11f90929f1dd8"} Aug 04 18:02:14.701406 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.701389 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:14.705990 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.705973 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" Aug 04 18:02:14.720724 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.720683 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" podStartSLOduration=1.6487521520000001 podStartE2EDuration="6.720669409s" totalImagesPullingTime="5.071917257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:14.71969787 +0000 UTC m=+131.022641794" watchObservedRunningTime="2026-08-04 18:02:14.720669409 +0000 UTC m=+131.023613334" Aug 04 18:02:14.750570 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.750522 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.023968658 podStartE2EDuration="7.750493027s" totalImagesPullingTime="4.709993398s" totalInitContainerRuntime="16.530971ms" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:14.748620616 +0000 UTC m=+131.051564536" watchObservedRunningTime="2026-08-04 18:02:14.750493027 +0000 UTC m=+131.053436951" Aug 04 18:02:14.775912 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:14.775816 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-tp6qf" podStartSLOduration=1.967596303 podStartE2EDuration="3.775775911s" totalImagesPullingTime="1.808179608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:14.775026228 +0000 UTC m=+131.077970151" watchObservedRunningTime="2026-08-04 18:02:14.775775911 +0000 UTC m=+131.078719835" Aug 04 18:02:16.711222 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:16.711187 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5brj6" event={"ID":"349d54df-5bd2-4a3f-8d94-25c6ec118a46","Type":"ContainerStarted","Data":"137c24d5b0476115b55a73692869e6e1bdc1f6e302b2cac69d5026c375d0ee70"} Aug 04 18:02:16.711710 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:16.711249 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5brj6" event={"ID":"349d54df-5bd2-4a3f-8d94-25c6ec118a46","Type":"ContainerStarted","Data":"8cec572f1460b8c619b6a3bfec3e496f62d0772e65a64dd82d7f9f917fb7e8ab"} Aug 04 18:02:16.730844 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:16.730788 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5brj6" podStartSLOduration=129.999387226 podStartE2EDuration="2m11.730771147s" totalImagesPullingTime="1.731383921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:16.729471006 +0000 UTC m=+133.032414931" watchObservedRunningTime="2026-08-04 18:02:16.730771147 +0000 UTC m=+133.033715070" Aug 04 18:02:17.717574 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:17.717537 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" event={"ID":"a8c29ddf-7656-4e28-8005-c38739080a89","Type":"ContainerStarted","Data":"a9a7678250a44368c260f9acfd993f980d941414be8d199a382d58c6278151c1"} Aug 04 18:02:17.718076 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:17.717633 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" event={"ID":"a8c29ddf-7656-4e28-8005-c38739080a89","Type":"ContainerStarted","Data":"99780a378af2946ec2312888d4aaf967b17c700fd5fbbb27bf8d8acd8e991e49"} Aug 04 18:02:17.718076 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:17.717668 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" event={"ID":"a8c29ddf-7656-4e28-8005-c38739080a89","Type":"ContainerStarted","Data":"bad42b51eedf011ce2a14061e46fc258df409ef1245e142908e472ebe4a08df3"} Aug 04 18:02:17.745823 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:17.745773 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-78c4cb6c88-9gsll" podStartSLOduration=1.845704521 podStartE2EDuration="6.745737293s" totalImagesPullingTime="4.900032772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:17.744361134 +0000 UTC m=+134.047305059" watchObservedRunningTime="2026-08-04 18:02:17.745737293 +0000 UTC m=+134.048681247" Aug 04 18:02:17.964872 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:17.964836 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57c44fd488-mvdr8"] Aug 04 18:02:17.967043 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:17.967028 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:17.980438 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:17.980408 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c44fd488-mvdr8"] Aug 04 18:02:18.098045 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.098005 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-service-ca\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.098246 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.098064 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvvth\" (UniqueName: \"kubernetes.io/projected/53c268af-8878-466e-aea0-c21abe017b64-kube-api-access-cvvth\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.098246 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.098152 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-serving-cert\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.098246 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.098201 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-trusted-ca-bundle\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.098246 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.098227 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-console-config\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.098412 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.098250 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-oauth-serving-cert\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.098412 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.098309 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-oauth-config\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.199240 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.199193 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-oauth-serving-cert\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.199240 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.199247 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-oauth-config\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.199527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.199368 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-service-ca\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.199527 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.199456 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvvth\" (UniqueName: \"kubernetes.io/projected/53c268af-8878-466e-aea0-c21abe017b64-kube-api-access-cvvth\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.199647 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.199537 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-serving-cert\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.199647 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.199569 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-trusted-ca-bundle\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.199647 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.199596 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-console-config\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.200119 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.200091 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-oauth-serving-cert\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.200260 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.200141 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-service-ca\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.200260 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.200247 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-console-config\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.200401 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.200379 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-trusted-ca-bundle\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.201630 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.201611 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-oauth-config\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.201822 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.201803 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-serving-cert\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.210318 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.210291 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvvth\" (UniqueName: \"kubernetes.io/projected/53c268af-8878-466e-aea0-c21abe017b64-kube-api-access-cvvth\") pod \"console-57c44fd488-mvdr8\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.275281 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.275176 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:18.406870 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.406830 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c44fd488-mvdr8"] Aug 04 18:02:18.408978 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:02:18.408954 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c268af_8878_466e_aea0_c21abe017b64.slice/crio-d9fcef881467dade49fd673536fde236a57ffa0333fe39f5b8915a69600d6113 WatchSource:0}: Error finding container d9fcef881467dade49fd673536fde236a57ffa0333fe39f5b8915a69600d6113: Status 404 returned error can't find the container with id d9fcef881467dade49fd673536fde236a57ffa0333fe39f5b8915a69600d6113 Aug 04 18:02:18.723238 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.723196 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c44fd488-mvdr8" event={"ID":"53c268af-8878-466e-aea0-c21abe017b64","Type":"ContainerStarted","Data":"15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26"} Aug 04 18:02:18.723654 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.723255 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c44fd488-mvdr8" event={"ID":"53c268af-8878-466e-aea0-c21abe017b64","Type":"ContainerStarted","Data":"d9fcef881467dade49fd673536fde236a57ffa0333fe39f5b8915a69600d6113"} Aug 04 18:02:18.752716 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:18.752664 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57c44fd488-mvdr8" podStartSLOduration=1.752646526 podStartE2EDuration="1.752646526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:02:18.751374195 +0000 UTC m=+135.054318115" watchObservedRunningTime="2026-08-04 18:02:18.752646526 +0000 UTC m=+135.055590451" Aug 04 18:02:20.711215 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:20.711178 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-744877fb47-hdnzh" Aug 04 18:02:28.276176 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:28.276143 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:28.276579 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:28.276210 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:28.280849 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:28.280825 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:28.772880 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:28.772852 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:02:28.855466 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:28.855438 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c79df868-dp7pg"] Aug 04 18:02:53.873289 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:53.873226 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77c79df868-dp7pg" podUID="32011f25-09dc-4925-acbe-8a5633293e85" containerName="console" containerID="cri-o://aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34" gracePeriod=15 Aug 04 18:02:54.109846 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.109822 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:02:54.169576 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169471 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-service-ca\") pod \"32011f25-09dc-4925-acbe-8a5633293e85\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " Aug 04 18:02:54.169576 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169529 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-oauth-serving-cert\") pod \"32011f25-09dc-4925-acbe-8a5633293e85\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " Aug 04 18:02:54.169576 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169566 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx2fj\" (UniqueName: \"kubernetes.io/projected/32011f25-09dc-4925-acbe-8a5633293e85-kube-api-access-jx2fj\") pod \"32011f25-09dc-4925-acbe-8a5633293e85\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " Aug 04 18:02:54.169819 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169589 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-console-config\") pod \"32011f25-09dc-4925-acbe-8a5633293e85\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " Aug 04 18:02:54.169819 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169628 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-serving-cert\") pod \"32011f25-09dc-4925-acbe-8a5633293e85\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " Aug 04 18:02:54.169819 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169663 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-trusted-ca-bundle\") pod \"32011f25-09dc-4925-acbe-8a5633293e85\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " Aug 04 18:02:54.169819 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169709 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-oauth-config\") pod \"32011f25-09dc-4925-acbe-8a5633293e85\" (UID: \"32011f25-09dc-4925-acbe-8a5633293e85\") " Aug 04 18:02:54.170016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169867 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-service-ca" (OuterVolumeSpecName: "service-ca") pod "32011f25-09dc-4925-acbe-8a5633293e85" (UID: "32011f25-09dc-4925-acbe-8a5633293e85"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:02:54.170016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169939 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "32011f25-09dc-4925-acbe-8a5633293e85" (UID: "32011f25-09dc-4925-acbe-8a5633293e85"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:02:54.170016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.169963 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-service-ca\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:54.170195 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.170067 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-console-config" (OuterVolumeSpecName: "console-config") pod "32011f25-09dc-4925-acbe-8a5633293e85" (UID: "32011f25-09dc-4925-acbe-8a5633293e85"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:02:54.170195 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.170169 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "32011f25-09dc-4925-acbe-8a5633293e85" (UID: "32011f25-09dc-4925-acbe-8a5633293e85"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:02:54.171831 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.171785 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "32011f25-09dc-4925-acbe-8a5633293e85" (UID: "32011f25-09dc-4925-acbe-8a5633293e85"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:02:54.171923 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.171850 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "32011f25-09dc-4925-acbe-8a5633293e85" (UID: "32011f25-09dc-4925-acbe-8a5633293e85"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:02:54.171923 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.171848 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32011f25-09dc-4925-acbe-8a5633293e85-kube-api-access-jx2fj" (OuterVolumeSpecName: "kube-api-access-jx2fj") pod "32011f25-09dc-4925-acbe-8a5633293e85" (UID: "32011f25-09dc-4925-acbe-8a5633293e85"). InnerVolumeSpecName "kube-api-access-jx2fj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 18:02:54.270483 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.270451 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-oauth-config\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:54.270483 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.270478 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-oauth-serving-cert\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:54.270658 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.270491 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx2fj\" (UniqueName: \"kubernetes.io/projected/32011f25-09dc-4925-acbe-8a5633293e85-kube-api-access-jx2fj\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:54.270658 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.270527 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-console-config\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:54.270658 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.270540 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32011f25-09dc-4925-acbe-8a5633293e85-console-serving-cert\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:54.270658 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.270551 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32011f25-09dc-4925-acbe-8a5633293e85-trusted-ca-bundle\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:02:54.867037 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.867001 2583 generic.go:356] "Generic (PLEG): container finished" podID="32011f25-09dc-4925-acbe-8a5633293e85" containerID="aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34" exitCode=0 Aug 04 18:02:54.867213 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.867051 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c79df868-dp7pg" Aug 04 18:02:54.867213 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.867083 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c79df868-dp7pg" event={"ID":"32011f25-09dc-4925-acbe-8a5633293e85","Type":"ContainerDied","Data":"aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34"} Aug 04 18:02:54.867213 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.867133 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c79df868-dp7pg" event={"ID":"32011f25-09dc-4925-acbe-8a5633293e85","Type":"ContainerDied","Data":"abcd27da6face5f6d556ffa96353074ad2b30d03dd9f12af24afe01732e2f9d8"} Aug 04 18:02:54.867213 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.867155 2583 scope.go:117] "RemoveContainer" containerID="aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34" Aug 04 18:02:54.875462 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.875306 2583 scope.go:117] "RemoveContainer" containerID="aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34" Aug 04 18:02:54.875720 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:02:54.875580 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34\": container with ID starting with aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34 not found: ID does not exist" containerID="aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34" Aug 04 18:02:54.875720 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.875605 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34"} err="failed to get container status \"aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34\": rpc error: code = NotFound desc = could not find container \"aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34\": container with ID starting with aa532b2b2c8ca43184a206e9a8e15aeaabc85863676850f5de702d72193f3d34 not found: ID does not exist" Aug 04 18:02:54.889785 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.889765 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c79df868-dp7pg"] Aug 04 18:02:54.904745 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:54.904725 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77c79df868-dp7pg"] Aug 04 18:02:56.155973 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:02:56.155899 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32011f25-09dc-4925-acbe-8a5633293e85" path="/var/lib/kubelet/pods/32011f25-09dc-4925-acbe-8a5633293e85/volumes" Aug 04 18:03:35.749176 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.749143 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76498567f7-44ll5"] Aug 04 18:03:35.749658 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.749452 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32011f25-09dc-4925-acbe-8a5633293e85" containerName="console" Aug 04 18:03:35.749658 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.749462 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="32011f25-09dc-4925-acbe-8a5633293e85" containerName="console" Aug 04 18:03:35.749658 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.749541 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="32011f25-09dc-4925-acbe-8a5633293e85" containerName="console" Aug 04 18:03:35.753888 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.753861 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:35.765269 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.765246 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76498567f7-44ll5"] Aug 04 18:03:35.912284 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.912253 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qvxz\" (UniqueName: \"kubernetes.io/projected/89a41b27-9b4d-4eac-928c-05fa08452e5d-kube-api-access-8qvxz\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:35.912432 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.912292 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-config\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:35.912432 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.912336 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-service-ca\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:35.912432 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.912362 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-serving-cert\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:35.912432 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.912382 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-trusted-ca-bundle\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:35.912432 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.912403 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-oauth-serving-cert\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:35.912432 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:35.912429 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-oauth-config\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.013807 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.013747 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-service-ca\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.013807 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.013779 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-serving-cert\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.013807 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.013796 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-trusted-ca-bundle\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.013995 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.013818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-oauth-serving-cert\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.013995 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.013845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-oauth-config\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.013995 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.013906 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qvxz\" (UniqueName: \"kubernetes.io/projected/89a41b27-9b4d-4eac-928c-05fa08452e5d-kube-api-access-8qvxz\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.013995 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.013936 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-config\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.015183 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.015140 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-config\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.015183 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.015060 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-trusted-ca-bundle\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.015362 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.015148 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-oauth-serving-cert\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.015362 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.015137 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-service-ca\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.020196 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.017048 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-serving-cert\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.020196 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.017566 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-oauth-config\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.023176 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.023154 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qvxz\" (UniqueName: \"kubernetes.io/projected/89a41b27-9b4d-4eac-928c-05fa08452e5d-kube-api-access-8qvxz\") pod \"console-76498567f7-44ll5\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.062410 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.062386 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:36.189025 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:36.188990 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76498567f7-44ll5"] Aug 04 18:03:36.191529 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:03:36.191487 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a41b27_9b4d_4eac_928c_05fa08452e5d.slice/crio-724c1f636cc877caf19f7d9244ba555fd6ab78e7bcf6f3575886479997617cc4 WatchSource:0}: Error finding container 724c1f636cc877caf19f7d9244ba555fd6ab78e7bcf6f3575886479997617cc4: Status 404 returned error can't find the container with id 724c1f636cc877caf19f7d9244ba555fd6ab78e7bcf6f3575886479997617cc4 Aug 04 18:03:37.037492 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:37.037462 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76498567f7-44ll5" event={"ID":"89a41b27-9b4d-4eac-928c-05fa08452e5d","Type":"ContainerStarted","Data":"7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1"} Aug 04 18:03:37.037871 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:37.037536 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76498567f7-44ll5" event={"ID":"89a41b27-9b4d-4eac-928c-05fa08452e5d","Type":"ContainerStarted","Data":"724c1f636cc877caf19f7d9244ba555fd6ab78e7bcf6f3575886479997617cc4"} Aug 04 18:03:37.060363 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:37.060316 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76498567f7-44ll5" podStartSLOduration=2.060303007 podStartE2EDuration="2.060303007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:03:37.058823673 +0000 UTC m=+213.361767597" watchObservedRunningTime="2026-08-04 18:03:37.060303007 +0000 UTC m=+213.363246932" Aug 04 18:03:46.063098 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:46.063049 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:46.063660 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:46.063128 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:46.067815 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:46.067790 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:46.079060 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:46.079041 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:03:46.148383 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:03:46.148346 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c44fd488-mvdr8"] Aug 04 18:04:11.167711 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.167654 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57c44fd488-mvdr8" podUID="53c268af-8878-466e-aea0-c21abe017b64" containerName="console" containerID="cri-o://15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26" gracePeriod=15 Aug 04 18:04:11.402914 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.402894 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:04:11.481535 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.481454 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-service-ca\") pod \"53c268af-8878-466e-aea0-c21abe017b64\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " Aug 04 18:04:11.481535 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.481488 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvvth\" (UniqueName: \"kubernetes.io/projected/53c268af-8878-466e-aea0-c21abe017b64-kube-api-access-cvvth\") pod \"53c268af-8878-466e-aea0-c21abe017b64\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " Aug 04 18:04:11.481713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.481590 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-oauth-serving-cert\") pod \"53c268af-8878-466e-aea0-c21abe017b64\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " Aug 04 18:04:11.481713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.481630 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-trusted-ca-bundle\") pod \"53c268af-8878-466e-aea0-c21abe017b64\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " Aug 04 18:04:11.481713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.481653 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-oauth-config\") pod \"53c268af-8878-466e-aea0-c21abe017b64\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " Aug 04 18:04:11.481713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.481702 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-console-config\") pod \"53c268af-8878-466e-aea0-c21abe017b64\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " Aug 04 18:04:11.481907 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.481737 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-serving-cert\") pod \"53c268af-8878-466e-aea0-c21abe017b64\" (UID: \"53c268af-8878-466e-aea0-c21abe017b64\") " Aug 04 18:04:11.481907 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.481880 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-service-ca" (OuterVolumeSpecName: "service-ca") pod "53c268af-8878-466e-aea0-c21abe017b64" (UID: "53c268af-8878-466e-aea0-c21abe017b64"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:04:11.482126 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.482061 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "53c268af-8878-466e-aea0-c21abe017b64" (UID: "53c268af-8878-466e-aea0-c21abe017b64"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:04:11.482126 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.482070 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "53c268af-8878-466e-aea0-c21abe017b64" (UID: "53c268af-8878-466e-aea0-c21abe017b64"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:04:11.482126 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.482118 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-console-config" (OuterVolumeSpecName: "console-config") pod "53c268af-8878-466e-aea0-c21abe017b64" (UID: "53c268af-8878-466e-aea0-c21abe017b64"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:04:11.482328 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.482141 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-service-ca\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:04:11.483658 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.483636 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53c268af-8878-466e-aea0-c21abe017b64-kube-api-access-cvvth" (OuterVolumeSpecName: "kube-api-access-cvvth") pod "53c268af-8878-466e-aea0-c21abe017b64" (UID: "53c268af-8878-466e-aea0-c21abe017b64"). InnerVolumeSpecName "kube-api-access-cvvth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 18:04:11.483771 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.483721 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "53c268af-8878-466e-aea0-c21abe017b64" (UID: "53c268af-8878-466e-aea0-c21abe017b64"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:04:11.483848 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.483825 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "53c268af-8878-466e-aea0-c21abe017b64" (UID: "53c268af-8878-466e-aea0-c21abe017b64"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:04:11.582814 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.582791 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvvth\" (UniqueName: \"kubernetes.io/projected/53c268af-8878-466e-aea0-c21abe017b64-kube-api-access-cvvth\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:04:11.582814 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.582814 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-oauth-serving-cert\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:04:11.582960 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.582823 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-trusted-ca-bundle\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:04:11.582960 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.582831 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-oauth-config\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:04:11.582960 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.582839 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/53c268af-8878-466e-aea0-c21abe017b64-console-config\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:04:11.582960 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:11.582848 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/53c268af-8878-466e-aea0-c21abe017b64-console-serving-cert\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:04:12.174900 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:12.174862 2583 generic.go:356] "Generic (PLEG): container finished" podID="53c268af-8878-466e-aea0-c21abe017b64" containerID="15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26" exitCode=0 Aug 04 18:04:12.175271 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:12.174923 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c44fd488-mvdr8" event={"ID":"53c268af-8878-466e-aea0-c21abe017b64","Type":"ContainerDied","Data":"15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26"} Aug 04 18:04:12.175271 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:12.174930 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c44fd488-mvdr8" Aug 04 18:04:12.175271 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:12.174966 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c44fd488-mvdr8" event={"ID":"53c268af-8878-466e-aea0-c21abe017b64","Type":"ContainerDied","Data":"d9fcef881467dade49fd673536fde236a57ffa0333fe39f5b8915a69600d6113"} Aug 04 18:04:12.175271 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:12.174988 2583 scope.go:117] "RemoveContainer" containerID="15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26" Aug 04 18:04:12.183477 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:12.183458 2583 scope.go:117] "RemoveContainer" containerID="15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26" Aug 04 18:04:12.183765 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:04:12.183742 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26\": container with ID starting with 15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26 not found: ID does not exist" containerID="15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26" Aug 04 18:04:12.183857 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:12.183770 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26"} err="failed to get container status \"15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26\": rpc error: code = NotFound desc = could not find container \"15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26\": container with ID starting with 15713b9e909c57433cbdd81465cb5e49b6d68c37c40c1852f0e32532dd0cdd26 not found: ID does not exist" Aug 04 18:04:12.197391 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:12.197369 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c44fd488-mvdr8"] Aug 04 18:04:12.199474 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:12.199455 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57c44fd488-mvdr8"] Aug 04 18:04:14.154456 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:04:14.154414 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53c268af-8878-466e-aea0-c21abe017b64" path="/var/lib/kubelet/pods/53c268af-8878-466e-aea0-c21abe017b64/volumes" Aug 04 18:05:04.023893 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:05:04.023862 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:05:04.029860 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:05:04.029837 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:05:04.036246 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:05:04.036225 2583 kubelet.go:1648] "Image garbage collection succeeded" Aug 04 18:06:03.449994 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.449912 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p"] Aug 04 18:06:03.450411 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.450256 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53c268af-8878-466e-aea0-c21abe017b64" containerName="console" Aug 04 18:06:03.450411 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.450271 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="53c268af-8878-466e-aea0-c21abe017b64" containerName="console" Aug 04 18:06:03.450411 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.450331 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="53c268af-8878-466e-aea0-c21abe017b64" containerName="console" Aug 04 18:06:03.453173 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.453157 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:06:03.456603 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.456585 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Aug 04 18:06:03.456883 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.456862 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-fhhp9\"" Aug 04 18:06:03.456989 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.456968 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Aug 04 18:06:03.457898 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.457879 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Aug 04 18:06:03.474194 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.474172 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p"] Aug 04 18:06:03.480804 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.480783 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8c87b531-e276-4fe3-98f0-db698937d960-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p\" (UID: \"8c87b531-e276-4fe3-98f0-db698937d960\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:06:03.480906 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.480851 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwmpb\" (UniqueName: \"kubernetes.io/projected/8c87b531-e276-4fe3-98f0-db698937d960-kube-api-access-qwmpb\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p\" (UID: \"8c87b531-e276-4fe3-98f0-db698937d960\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:06:03.581909 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.581883 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwmpb\" (UniqueName: \"kubernetes.io/projected/8c87b531-e276-4fe3-98f0-db698937d960-kube-api-access-qwmpb\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p\" (UID: \"8c87b531-e276-4fe3-98f0-db698937d960\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:06:03.582057 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.581925 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8c87b531-e276-4fe3-98f0-db698937d960-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p\" (UID: \"8c87b531-e276-4fe3-98f0-db698937d960\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:06:03.584128 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.584105 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8c87b531-e276-4fe3-98f0-db698937d960-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p\" (UID: \"8c87b531-e276-4fe3-98f0-db698937d960\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:06:03.596286 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.596265 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwmpb\" (UniqueName: \"kubernetes.io/projected/8c87b531-e276-4fe3-98f0-db698937d960-kube-api-access-qwmpb\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p\" (UID: \"8c87b531-e276-4fe3-98f0-db698937d960\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:06:03.763136 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.763062 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:06:03.894914 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.894877 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p"] Aug 04 18:06:03.898020 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:06:03.897989 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c87b531_e276_4fe3_98f0_db698937d960.slice/crio-56a5c4bf890fec5952748e1f96fe1be12e90545b8626081bf7828fee56068711 WatchSource:0}: Error finding container 56a5c4bf890fec5952748e1f96fe1be12e90545b8626081bf7828fee56068711: Status 404 returned error can't find the container with id 56a5c4bf890fec5952748e1f96fe1be12e90545b8626081bf7828fee56068711 Aug 04 18:06:03.900246 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:03.900225 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 18:06:04.604874 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:04.604832 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" event={"ID":"8c87b531-e276-4fe3-98f0-db698937d960","Type":"ContainerStarted","Data":"56a5c4bf890fec5952748e1f96fe1be12e90545b8626081bf7828fee56068711"} Aug 04 18:06:07.620792 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:07.620754 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" event={"ID":"8c87b531-e276-4fe3-98f0-db698937d960","Type":"ContainerStarted","Data":"60c069f528508c821a7ba1c64e7befd404680c74b832080c8d74038ac5798f0b"} Aug 04 18:06:07.621159 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:07.620895 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:06:07.644666 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:07.644614 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" podStartSLOduration=1.728493905 podStartE2EDuration="4.644597939s" totalImagesPullingTime="2.916104034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:06:07.643985777 +0000 UTC m=+363.946929703" watchObservedRunningTime="2026-08-04 18:06:07.644597939 +0000 UTC m=+363.947541865" Aug 04 18:06:08.205444 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.205413 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-mntkb"] Aug 04 18:06:08.208781 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.208765 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.211027 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.210997 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Aug 04 18:06:08.211027 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.211007 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-tkd5p\"" Aug 04 18:06:08.211027 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.211009 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Aug 04 18:06:08.217626 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.217602 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-mntkb"] Aug 04 18:06:08.322030 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.322001 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1f7922ab-9873-41d6-bf43-22ec2292bd40-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.322202 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.322045 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1f7922ab-9873-41d6-bf43-22ec2292bd40-certificates\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.322202 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.322074 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6swzq\" (UniqueName: \"kubernetes.io/projected/1f7922ab-9873-41d6-bf43-22ec2292bd40-kube-api-access-6swzq\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.422487 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.422457 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1f7922ab-9873-41d6-bf43-22ec2292bd40-certificates\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.422487 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.422490 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6swzq\" (UniqueName: \"kubernetes.io/projected/1f7922ab-9873-41d6-bf43-22ec2292bd40-kube-api-access-6swzq\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.422713 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.422593 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1f7922ab-9873-41d6-bf43-22ec2292bd40-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.422713 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:06:08.422612 2583 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found Aug 04 18:06:08.422713 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:06:08.422637 2583 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-mntkb: secret "keda-metrics-apiserver-certs" not found Aug 04 18:06:08.422713 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:06:08.422683 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f7922ab-9873-41d6-bf43-22ec2292bd40-certificates podName:1f7922ab-9873-41d6-bf43-22ec2292bd40 nodeName:}" failed. No retries permitted until 2026-08-04 18:06:08.922667957 +0000 UTC m=+365.225611864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/1f7922ab-9873-41d6-bf43-22ec2292bd40-certificates") pod "keda-metrics-apiserver-55557df8c-mntkb" (UID: "1f7922ab-9873-41d6-bf43-22ec2292bd40") : secret "keda-metrics-apiserver-certs" not found Aug 04 18:06:08.422924 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.422907 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1f7922ab-9873-41d6-bf43-22ec2292bd40-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.434413 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.434381 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6swzq\" (UniqueName: \"kubernetes.io/projected/1f7922ab-9873-41d6-bf43-22ec2292bd40-kube-api-access-6swzq\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.927303 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.927270 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1f7922ab-9873-41d6-bf43-22ec2292bd40-certificates\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:08.929687 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:08.929663 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1f7922ab-9873-41d6-bf43-22ec2292bd40-certificates\") pod \"keda-metrics-apiserver-55557df8c-mntkb\" (UID: \"1f7922ab-9873-41d6-bf43-22ec2292bd40\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:09.120172 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:09.120143 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:09.249475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:09.249447 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-mntkb"] Aug 04 18:06:09.252108 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:06:09.252080 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7922ab_9873_41d6_bf43_22ec2292bd40.slice/crio-9599fbdf280c18f3a0de284f9afab08cc672272ff89cc7868e5e9448df5ae11b WatchSource:0}: Error finding container 9599fbdf280c18f3a0de284f9afab08cc672272ff89cc7868e5e9448df5ae11b: Status 404 returned error can't find the container with id 9599fbdf280c18f3a0de284f9afab08cc672272ff89cc7868e5e9448df5ae11b Aug 04 18:06:09.633081 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:09.633042 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" event={"ID":"1f7922ab-9873-41d6-bf43-22ec2292bd40","Type":"ContainerStarted","Data":"9599fbdf280c18f3a0de284f9afab08cc672272ff89cc7868e5e9448df5ae11b"} Aug 04 18:06:12.652629 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:12.652538 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" event={"ID":"1f7922ab-9873-41d6-bf43-22ec2292bd40","Type":"ContainerStarted","Data":"4954d48bc19a2ff412ec11fda3683ec000fa089c4082931f79c3eda70d595edc"} Aug 04 18:06:12.652984 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:12.652661 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:12.671952 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:12.671906 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" podStartSLOduration=1.540863758 podStartE2EDuration="4.67189459s" totalImagesPullingTime="3.131030832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:06:12.670696004 +0000 UTC m=+368.973639929" watchObservedRunningTime="2026-08-04 18:06:12.67189459 +0000 UTC m=+368.974838533" Aug 04 18:06:23.661358 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:23.661330 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-mntkb" Aug 04 18:06:28.627735 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:06:28.627697 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2zd2p" Aug 04 18:07:25.794148 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.794113 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-xln8c"] Aug 04 18:07:25.797356 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.797336 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:25.801390 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.801364 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-qz2cb\"" Aug 04 18:07:25.802197 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.802181 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Aug 04 18:07:25.802293 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.802214 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Aug 04 18:07:25.803702 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.803678 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Aug 04 18:07:25.810145 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.810123 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-xln8c"] Aug 04 18:07:25.840688 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.840662 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-nt7tt"] Aug 04 18:07:25.843861 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.843846 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:07:25.846721 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.846702 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-6slp5\"" Aug 04 18:07:25.854545 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.854527 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Aug 04 18:07:25.860177 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.860156 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-nt7tt"] Aug 04 18:07:25.945008 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.944971 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp6tc\" (UniqueName: \"kubernetes.io/projected/488b96d0-4363-4055-a953-6511d9329e27-kube-api-access-rp6tc\") pod \"seaweedfs-64568bcd49-nt7tt\" (UID: \"488b96d0-4363-4055-a953-6511d9329e27\") " pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:07:25.945190 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.945037 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6-cert\") pod \"llmisvc-controller-manager-654c557856-xln8c\" (UID: \"ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6\") " pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:25.945190 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.945081 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/488b96d0-4363-4055-a953-6511d9329e27-data\") pod \"seaweedfs-64568bcd49-nt7tt\" (UID: \"488b96d0-4363-4055-a953-6511d9329e27\") " pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:07:25.945190 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:25.945106 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk7xm\" (UniqueName: \"kubernetes.io/projected/ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6-kube-api-access-fk7xm\") pod \"llmisvc-controller-manager-654c557856-xln8c\" (UID: \"ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6\") " pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:26.045919 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.045800 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/488b96d0-4363-4055-a953-6511d9329e27-data\") pod \"seaweedfs-64568bcd49-nt7tt\" (UID: \"488b96d0-4363-4055-a953-6511d9329e27\") " pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:07:26.045919 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.045842 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk7xm\" (UniqueName: \"kubernetes.io/projected/ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6-kube-api-access-fk7xm\") pod \"llmisvc-controller-manager-654c557856-xln8c\" (UID: \"ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6\") " pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:26.045919 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.045885 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp6tc\" (UniqueName: \"kubernetes.io/projected/488b96d0-4363-4055-a953-6511d9329e27-kube-api-access-rp6tc\") pod \"seaweedfs-64568bcd49-nt7tt\" (UID: \"488b96d0-4363-4055-a953-6511d9329e27\") " pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:07:26.046178 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.045937 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6-cert\") pod \"llmisvc-controller-manager-654c557856-xln8c\" (UID: \"ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6\") " pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:26.046178 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:07:26.046028 2583 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Aug 04 18:07:26.046178 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:07:26.046091 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6-cert podName:ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6 nodeName:}" failed. No retries permitted until 2026-08-04 18:07:26.546072249 +0000 UTC m=+442.849016157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6-cert") pod "llmisvc-controller-manager-654c557856-xln8c" (UID: "ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6") : secret "llmisvc-webhook-server-cert" not found Aug 04 18:07:26.046328 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.046204 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/488b96d0-4363-4055-a953-6511d9329e27-data\") pod \"seaweedfs-64568bcd49-nt7tt\" (UID: \"488b96d0-4363-4055-a953-6511d9329e27\") " pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:07:26.057145 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.057121 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp6tc\" (UniqueName: \"kubernetes.io/projected/488b96d0-4363-4055-a953-6511d9329e27-kube-api-access-rp6tc\") pod \"seaweedfs-64568bcd49-nt7tt\" (UID: \"488b96d0-4363-4055-a953-6511d9329e27\") " pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:07:26.059562 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.059540 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk7xm\" (UniqueName: \"kubernetes.io/projected/ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6-kube-api-access-fk7xm\") pod \"llmisvc-controller-manager-654c557856-xln8c\" (UID: \"ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6\") " pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:26.152752 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.152726 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:07:26.283042 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.283017 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-nt7tt"] Aug 04 18:07:26.285747 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:07:26.285719 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488b96d0_4363_4055_a953_6511d9329e27.slice/crio-d56f7a78ae1a96ba539a448168852266e48f02c6f9eaadf0bf94aac7cb6d02c0 WatchSource:0}: Error finding container d56f7a78ae1a96ba539a448168852266e48f02c6f9eaadf0bf94aac7cb6d02c0: Status 404 returned error can't find the container with id d56f7a78ae1a96ba539a448168852266e48f02c6f9eaadf0bf94aac7cb6d02c0 Aug 04 18:07:26.551129 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.551097 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6-cert\") pod \"llmisvc-controller-manager-654c557856-xln8c\" (UID: \"ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6\") " pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:26.553456 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.553436 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6-cert\") pod \"llmisvc-controller-manager-654c557856-xln8c\" (UID: \"ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6\") " pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:26.709153 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.709114 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:26.857903 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.857716 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-xln8c"] Aug 04 18:07:26.862559 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:07:26.862526 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podddd4cb12_cff4_4bdf_9ce0_70fc4a8100b6.slice/crio-2b70afbbd89ab2fef673d39a4b25f22a78cd15500aed0808cd327ae0c0e3eccf WatchSource:0}: Error finding container 2b70afbbd89ab2fef673d39a4b25f22a78cd15500aed0808cd327ae0c0e3eccf: Status 404 returned error can't find the container with id 2b70afbbd89ab2fef673d39a4b25f22a78cd15500aed0808cd327ae0c0e3eccf Aug 04 18:07:26.965349 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.965308 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-nt7tt" event={"ID":"488b96d0-4363-4055-a953-6511d9329e27","Type":"ContainerStarted","Data":"d56f7a78ae1a96ba539a448168852266e48f02c6f9eaadf0bf94aac7cb6d02c0"} Aug 04 18:07:26.966317 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:26.966295 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-xln8c" event={"ID":"ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6","Type":"ContainerStarted","Data":"2b70afbbd89ab2fef673d39a4b25f22a78cd15500aed0808cd327ae0c0e3eccf"} Aug 04 18:07:30.987201 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:30.987162 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-nt7tt" event={"ID":"488b96d0-4363-4055-a953-6511d9329e27","Type":"ContainerStarted","Data":"bd6186f6902105d4e6ffeb35f7de936fbc337087126dca987547e487cf8eb623"} Aug 04 18:07:30.987657 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:30.987250 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:07:30.988687 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:30.988662 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-xln8c" event={"ID":"ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6","Type":"ContainerStarted","Data":"57d4fcbfc079a8e849bf88d04baf99faaf3b01b0e3ce87a5529da4d8b1cd4f0d"} Aug 04 18:07:30.988784 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:30.988762 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:07:31.013998 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:31.013959 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-nt7tt" podStartSLOduration=1.964941939 podStartE2EDuration="6.013946015s" totalImagesPullingTime="4.049004076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:07:31.011814476 +0000 UTC m=+447.314758412" watchObservedRunningTime="2026-08-04 18:07:31.013946015 +0000 UTC m=+447.316889939" Aug 04 18:07:31.030479 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:31.030426 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-xln8c" podStartSLOduration=2.558285048 podStartE2EDuration="6.030408924s" totalImagesPullingTime="3.472123876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:07:31.030259985 +0000 UTC m=+447.333203911" watchObservedRunningTime="2026-08-04 18:07:31.030408924 +0000 UTC m=+447.333352849" Aug 04 18:07:36.995187 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:07:36.995157 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-nt7tt" Aug 04 18:08:01.994355 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:01.994325 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-xln8c" Aug 04 18:08:43.889741 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:43.889705 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-x9tx2"] Aug 04 18:08:43.892025 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:43.892008 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:08:43.894367 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:43.894345 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Aug 04 18:08:43.894627 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:43.894612 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-dtw6v\"" Aug 04 18:08:43.905131 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:43.905108 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-x9tx2"] Aug 04 18:08:44.082866 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:44.082829 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84e89d1a-e266-4cd6-a7f2-fab34faeca3b-tls-certs\") pod \"model-serving-api-7b954ffc95-x9tx2\" (UID: \"84e89d1a-e266-4cd6-a7f2-fab34faeca3b\") " pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:08:44.083033 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:44.082875 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mpsm\" (UniqueName: \"kubernetes.io/projected/84e89d1a-e266-4cd6-a7f2-fab34faeca3b-kube-api-access-9mpsm\") pod \"model-serving-api-7b954ffc95-x9tx2\" (UID: \"84e89d1a-e266-4cd6-a7f2-fab34faeca3b\") " pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:08:44.184408 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:44.184311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84e89d1a-e266-4cd6-a7f2-fab34faeca3b-tls-certs\") pod \"model-serving-api-7b954ffc95-x9tx2\" (UID: \"84e89d1a-e266-4cd6-a7f2-fab34faeca3b\") " pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:08:44.184408 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:44.184374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mpsm\" (UniqueName: \"kubernetes.io/projected/84e89d1a-e266-4cd6-a7f2-fab34faeca3b-kube-api-access-9mpsm\") pod \"model-serving-api-7b954ffc95-x9tx2\" (UID: \"84e89d1a-e266-4cd6-a7f2-fab34faeca3b\") " pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:08:44.184672 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:08:44.184460 2583 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Aug 04 18:08:44.184672 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:08:44.184560 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84e89d1a-e266-4cd6-a7f2-fab34faeca3b-tls-certs podName:84e89d1a-e266-4cd6-a7f2-fab34faeca3b nodeName:}" failed. No retries permitted until 2026-08-04 18:08:44.684538949 +0000 UTC m=+520.987482853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/84e89d1a-e266-4cd6-a7f2-fab34faeca3b-tls-certs") pod "model-serving-api-7b954ffc95-x9tx2" (UID: "84e89d1a-e266-4cd6-a7f2-fab34faeca3b") : secret "model-serving-api-tls" not found Aug 04 18:08:44.195664 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:44.195641 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mpsm\" (UniqueName: \"kubernetes.io/projected/84e89d1a-e266-4cd6-a7f2-fab34faeca3b-kube-api-access-9mpsm\") pod \"model-serving-api-7b954ffc95-x9tx2\" (UID: \"84e89d1a-e266-4cd6-a7f2-fab34faeca3b\") " pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:08:44.689016 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:44.688981 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84e89d1a-e266-4cd6-a7f2-fab34faeca3b-tls-certs\") pod \"model-serving-api-7b954ffc95-x9tx2\" (UID: \"84e89d1a-e266-4cd6-a7f2-fab34faeca3b\") " pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:08:44.691366 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:44.691343 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84e89d1a-e266-4cd6-a7f2-fab34faeca3b-tls-certs\") pod \"model-serving-api-7b954ffc95-x9tx2\" (UID: \"84e89d1a-e266-4cd6-a7f2-fab34faeca3b\") " pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:08:44.804639 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:44.804606 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:08:44.929698 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:44.929672 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-x9tx2"] Aug 04 18:08:44.932012 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:08:44.931986 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e89d1a_e266_4cd6_a7f2_fab34faeca3b.slice/crio-fc3cfc118a5f276c2a2f30907363e0f58edeff3f2fb4e9b0b60a76023da6969c WatchSource:0}: Error finding container fc3cfc118a5f276c2a2f30907363e0f58edeff3f2fb4e9b0b60a76023da6969c: Status 404 returned error can't find the container with id fc3cfc118a5f276c2a2f30907363e0f58edeff3f2fb4e9b0b60a76023da6969c Aug 04 18:08:45.298998 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:45.298963 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-x9tx2" event={"ID":"84e89d1a-e266-4cd6-a7f2-fab34faeca3b","Type":"ContainerStarted","Data":"fc3cfc118a5f276c2a2f30907363e0f58edeff3f2fb4e9b0b60a76023da6969c"} Aug 04 18:08:48.316706 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:48.314480 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-x9tx2" event={"ID":"84e89d1a-e266-4cd6-a7f2-fab34faeca3b","Type":"ContainerStarted","Data":"c5ffe695c20415bfbd49183c2a6f48a1565198bc8b1fba83de4ddc393d2ae525"} Aug 04 18:08:48.316706 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:08:48.315085 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:09:00.332006 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:09:00.331923 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-x9tx2" Aug 04 18:09:00.352318 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:09:00.352273 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-x9tx2" podStartSLOduration=14.750499938 podStartE2EDuration="17.352258055s" totalImagesPullingTime="2.601758117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:08:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:08:48.335279994 +0000 UTC m=+524.638223906" watchObservedRunningTime="2026-08-04 18:09:00.352258055 +0000 UTC m=+536.655201979" Aug 04 18:10:04.056992 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:10:04.056964 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:10:04.059003 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:10:04.058975 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:12:36.478882 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.478791 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-767b58899d-lm6gq"] Aug 04 18:12:36.482140 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.482117 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.494948 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.494922 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767b58899d-lm6gq"] Aug 04 18:12:36.541862 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.541834 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/757c4d5a-26ce-4546-a39c-ddf49480ffd8-console-oauth-config\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.542032 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.541879 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-service-ca\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.542032 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.541917 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-oauth-serving-cert\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.542032 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.541939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-trusted-ca-bundle\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.542032 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.541966 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-console-config\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.542032 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.541985 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/757c4d5a-26ce-4546-a39c-ddf49480ffd8-console-serving-cert\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.542032 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.542015 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb77w\" (UniqueName: \"kubernetes.io/projected/757c4d5a-26ce-4546-a39c-ddf49480ffd8-kube-api-access-pb77w\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.643423 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.643391 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb77w\" (UniqueName: \"kubernetes.io/projected/757c4d5a-26ce-4546-a39c-ddf49480ffd8-kube-api-access-pb77w\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.643614 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.643447 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/757c4d5a-26ce-4546-a39c-ddf49480ffd8-console-oauth-config\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.643614 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.643574 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-service-ca\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.643614 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.643611 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-oauth-serving-cert\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.643762 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.643630 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-trusted-ca-bundle\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.643762 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.643660 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-console-config\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.643762 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.643687 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/757c4d5a-26ce-4546-a39c-ddf49480ffd8-console-serving-cert\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.644249 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.644228 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-oauth-serving-cert\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.644364 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.644322 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-service-ca\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.644364 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.644354 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-console-config\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.644682 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.644661 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/757c4d5a-26ce-4546-a39c-ddf49480ffd8-trusted-ca-bundle\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.645914 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.645898 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/757c4d5a-26ce-4546-a39c-ddf49480ffd8-console-oauth-config\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.646070 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.646052 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/757c4d5a-26ce-4546-a39c-ddf49480ffd8-console-serving-cert\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.652800 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.652779 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb77w\" (UniqueName: \"kubernetes.io/projected/757c4d5a-26ce-4546-a39c-ddf49480ffd8-kube-api-access-pb77w\") pod \"console-767b58899d-lm6gq\" (UID: \"757c4d5a-26ce-4546-a39c-ddf49480ffd8\") " pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.791951 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.791866 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:36.923665 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:36.923634 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767b58899d-lm6gq"] Aug 04 18:12:36.927489 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:12:36.927463 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757c4d5a_26ce_4546_a39c_ddf49480ffd8.slice/crio-40aff840535da451fe8de0e83e98e21c135349a65ab414525b1909d873331d4e WatchSource:0}: Error finding container 40aff840535da451fe8de0e83e98e21c135349a65ab414525b1909d873331d4e: Status 404 returned error can't find the container with id 40aff840535da451fe8de0e83e98e21c135349a65ab414525b1909d873331d4e Aug 04 18:12:37.316085 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:37.316043 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767b58899d-lm6gq" event={"ID":"757c4d5a-26ce-4546-a39c-ddf49480ffd8","Type":"ContainerStarted","Data":"004e96eed8d2fe41f5589f1ed27230928acbfd54c8a926ad8775fc7824834e0f"} Aug 04 18:12:37.316259 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:37.316099 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767b58899d-lm6gq" event={"ID":"757c4d5a-26ce-4546-a39c-ddf49480ffd8","Type":"ContainerStarted","Data":"40aff840535da451fe8de0e83e98e21c135349a65ab414525b1909d873331d4e"} Aug 04 18:12:37.334208 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:37.334164 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-767b58899d-lm6gq" podStartSLOduration=1.334149278 podStartE2EDuration="1.334149278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:12:37.333357835 +0000 UTC m=+753.636301760" watchObservedRunningTime="2026-08-04 18:12:37.334149278 +0000 UTC m=+753.637093202" Aug 04 18:12:46.792113 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:46.792070 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:46.792599 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:46.792138 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:46.796942 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:46.796920 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:47.361520 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:47.361478 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-767b58899d-lm6gq" Aug 04 18:12:47.412787 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:12:47.412756 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76498567f7-44ll5"] Aug 04 18:13:12.436876 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.436832 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76498567f7-44ll5" podUID="89a41b27-9b4d-4eac-928c-05fa08452e5d" containerName="console" containerID="cri-o://7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1" gracePeriod=15 Aug 04 18:13:12.679953 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.679930 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:13:12.765180 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765108 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-oauth-serving-cert\") pod \"89a41b27-9b4d-4eac-928c-05fa08452e5d\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " Aug 04 18:13:12.765180 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765140 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-serving-cert\") pod \"89a41b27-9b4d-4eac-928c-05fa08452e5d\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " Aug 04 18:13:12.765180 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765179 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-oauth-config\") pod \"89a41b27-9b4d-4eac-928c-05fa08452e5d\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " Aug 04 18:13:12.765407 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765206 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qvxz\" (UniqueName: \"kubernetes.io/projected/89a41b27-9b4d-4eac-928c-05fa08452e5d-kube-api-access-8qvxz\") pod \"89a41b27-9b4d-4eac-928c-05fa08452e5d\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " Aug 04 18:13:12.765407 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765234 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-trusted-ca-bundle\") pod \"89a41b27-9b4d-4eac-928c-05fa08452e5d\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " Aug 04 18:13:12.765407 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765320 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-service-ca\") pod \"89a41b27-9b4d-4eac-928c-05fa08452e5d\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " Aug 04 18:13:12.765407 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765364 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-config\") pod \"89a41b27-9b4d-4eac-928c-05fa08452e5d\" (UID: \"89a41b27-9b4d-4eac-928c-05fa08452e5d\") " Aug 04 18:13:12.765678 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765540 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "89a41b27-9b4d-4eac-928c-05fa08452e5d" (UID: "89a41b27-9b4d-4eac-928c-05fa08452e5d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:13:12.765754 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765726 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-service-ca" (OuterVolumeSpecName: "service-ca") pod "89a41b27-9b4d-4eac-928c-05fa08452e5d" (UID: "89a41b27-9b4d-4eac-928c-05fa08452e5d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:13:12.765874 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765844 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "89a41b27-9b4d-4eac-928c-05fa08452e5d" (UID: "89a41b27-9b4d-4eac-928c-05fa08452e5d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:13:12.765942 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.765910 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-config" (OuterVolumeSpecName: "console-config") pod "89a41b27-9b4d-4eac-928c-05fa08452e5d" (UID: "89a41b27-9b4d-4eac-928c-05fa08452e5d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:13:12.767272 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.767248 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "89a41b27-9b4d-4eac-928c-05fa08452e5d" (UID: "89a41b27-9b4d-4eac-928c-05fa08452e5d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:13:12.767346 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.767248 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89a41b27-9b4d-4eac-928c-05fa08452e5d-kube-api-access-8qvxz" (OuterVolumeSpecName: "kube-api-access-8qvxz") pod "89a41b27-9b4d-4eac-928c-05fa08452e5d" (UID: "89a41b27-9b4d-4eac-928c-05fa08452e5d"). InnerVolumeSpecName "kube-api-access-8qvxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 04 18:13:12.767346 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.767278 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "89a41b27-9b4d-4eac-928c-05fa08452e5d" (UID: "89a41b27-9b4d-4eac-928c-05fa08452e5d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:13:12.866862 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.866833 2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-oauth-config\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:13:12.866862 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.866861 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qvxz\" (UniqueName: \"kubernetes.io/projected/89a41b27-9b4d-4eac-928c-05fa08452e5d-kube-api-access-8qvxz\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:13:12.866862 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.866870 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-trusted-ca-bundle\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:13:12.867063 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.866879 2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-service-ca\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:13:12.867063 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.866887 2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-config\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:13:12.867063 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.866895 2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89a41b27-9b4d-4eac-928c-05fa08452e5d-oauth-serving-cert\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:13:12.867063 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:12.866904 2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89a41b27-9b4d-4eac-928c-05fa08452e5d-console-serving-cert\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:13:13.469664 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:13.469621 2583 generic.go:356] "Generic (PLEG): container finished" podID="89a41b27-9b4d-4eac-928c-05fa08452e5d" containerID="7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1" exitCode=0 Aug 04 18:13:13.470061 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:13.469673 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76498567f7-44ll5" Aug 04 18:13:13.470061 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:13.469706 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76498567f7-44ll5" event={"ID":"89a41b27-9b4d-4eac-928c-05fa08452e5d","Type":"ContainerDied","Data":"7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1"} Aug 04 18:13:13.470061 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:13.469757 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76498567f7-44ll5" event={"ID":"89a41b27-9b4d-4eac-928c-05fa08452e5d","Type":"ContainerDied","Data":"724c1f636cc877caf19f7d9244ba555fd6ab78e7bcf6f3575886479997617cc4"} Aug 04 18:13:13.470061 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:13.469778 2583 scope.go:117] "RemoveContainer" containerID="7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1" Aug 04 18:13:13.478222 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:13.478205 2583 scope.go:117] "RemoveContainer" containerID="7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1" Aug 04 18:13:13.478465 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:13:13.478450 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1\": container with ID starting with 7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1 not found: ID does not exist" containerID="7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1" Aug 04 18:13:13.478552 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:13.478477 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1"} err="failed to get container status \"7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1\": rpc error: code = NotFound desc = could not find container \"7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1\": container with ID starting with 7055110aa95cb58792a79946a2d25c7e71d66f8ac39e2be2ddaca8bd8ff264e1 not found: ID does not exist" Aug 04 18:13:13.492158 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:13.492138 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76498567f7-44ll5"] Aug 04 18:13:13.497065 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:13.497044 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76498567f7-44ll5"] Aug 04 18:13:14.157192 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:13:14.157155 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89a41b27-9b4d-4eac-928c-05fa08452e5d" path="/var/lib/kubelet/pods/89a41b27-9b4d-4eac-928c-05fa08452e5d/volumes" Aug 04 18:14:05.918702 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.918670 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6"] Aug 04 18:14:05.919078 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.919022 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89a41b27-9b4d-4eac-928c-05fa08452e5d" containerName="console" Aug 04 18:14:05.919078 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.919034 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="89a41b27-9b4d-4eac-928c-05fa08452e5d" containerName="console" Aug 04 18:14:05.919149 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.919108 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="89a41b27-9b4d-4eac-928c-05fa08452e5d" containerName="console" Aug 04 18:14:05.922515 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.922484 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:05.925865 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.925846 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Aug 04 18:14:05.926109 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.926088 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-c55f6-serving-cert\"" Aug 04 18:14:05.926326 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.926312 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vsp4f\"" Aug 04 18:14:05.926912 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.926897 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-c55f6-kube-rbac-proxy-sar-config\"" Aug 04 18:14:05.936115 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:05.936092 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6"] Aug 04 18:14:06.017389 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.017352 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a89ada0-532c-4595-8614-7acc5ef5e706-openshift-service-ca-bundle\") pod \"model-chainer-raw-c55f6-75bdf6dd64-8zxl6\" (UID: \"9a89ada0-532c-4595-8614-7acc5ef5e706\") " pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:06.017613 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.017419 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a89ada0-532c-4595-8614-7acc5ef5e706-proxy-tls\") pod \"model-chainer-raw-c55f6-75bdf6dd64-8zxl6\" (UID: \"9a89ada0-532c-4595-8614-7acc5ef5e706\") " pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:06.117825 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.117789 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a89ada0-532c-4595-8614-7acc5ef5e706-openshift-service-ca-bundle\") pod \"model-chainer-raw-c55f6-75bdf6dd64-8zxl6\" (UID: \"9a89ada0-532c-4595-8614-7acc5ef5e706\") " pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:06.117978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.117868 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a89ada0-532c-4595-8614-7acc5ef5e706-proxy-tls\") pod \"model-chainer-raw-c55f6-75bdf6dd64-8zxl6\" (UID: \"9a89ada0-532c-4595-8614-7acc5ef5e706\") " pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:06.117978 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:14:06.117957 2583 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-c55f6-serving-cert: secret "model-chainer-raw-c55f6-serving-cert" not found Aug 04 18:14:06.118048 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:14:06.118023 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a89ada0-532c-4595-8614-7acc5ef5e706-proxy-tls podName:9a89ada0-532c-4595-8614-7acc5ef5e706 nodeName:}" failed. No retries permitted until 2026-08-04 18:14:06.618006554 +0000 UTC m=+842.920950457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9a89ada0-532c-4595-8614-7acc5ef5e706-proxy-tls") pod "model-chainer-raw-c55f6-75bdf6dd64-8zxl6" (UID: "9a89ada0-532c-4595-8614-7acc5ef5e706") : secret "model-chainer-raw-c55f6-serving-cert" not found Aug 04 18:14:06.118651 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.118626 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a89ada0-532c-4595-8614-7acc5ef5e706-openshift-service-ca-bundle\") pod \"model-chainer-raw-c55f6-75bdf6dd64-8zxl6\" (UID: \"9a89ada0-532c-4595-8614-7acc5ef5e706\") " pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:06.623545 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.623480 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a89ada0-532c-4595-8614-7acc5ef5e706-proxy-tls\") pod \"model-chainer-raw-c55f6-75bdf6dd64-8zxl6\" (UID: \"9a89ada0-532c-4595-8614-7acc5ef5e706\") " pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:06.625799 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.625777 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a89ada0-532c-4595-8614-7acc5ef5e706-proxy-tls\") pod \"model-chainer-raw-c55f6-75bdf6dd64-8zxl6\" (UID: \"9a89ada0-532c-4595-8614-7acc5ef5e706\") " pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:06.834327 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.834301 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:06.964111 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.964084 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6"] Aug 04 18:14:06.966253 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:14:06.966223 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a89ada0_532c_4595_8614_7acc5ef5e706.slice/crio-75da4372abf1726af7235aa496261611e8dfdf16b6f666644a465acafadeccb7 WatchSource:0}: Error finding container 75da4372abf1726af7235aa496261611e8dfdf16b6f666644a465acafadeccb7: Status 404 returned error can't find the container with id 75da4372abf1726af7235aa496261611e8dfdf16b6f666644a465acafadeccb7 Aug 04 18:14:06.968025 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:06.968005 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 04 18:14:07.706345 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:07.706306 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" event={"ID":"9a89ada0-532c-4595-8614-7acc5ef5e706","Type":"ContainerStarted","Data":"75da4372abf1726af7235aa496261611e8dfdf16b6f666644a465acafadeccb7"} Aug 04 18:14:09.720657 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:09.720622 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" event={"ID":"9a89ada0-532c-4595-8614-7acc5ef5e706","Type":"ContainerStarted","Data":"09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2"} Aug 04 18:14:09.721104 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:09.720757 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:09.738562 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:09.738493 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" podStartSLOduration=2.64353745 podStartE2EDuration="4.738476458s" totalImagesPullingTime="2.094939008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:14:09.73802526 +0000 UTC m=+846.040969187" watchObservedRunningTime="2026-08-04 18:14:09.738476458 +0000 UTC m=+846.041420386" Aug 04 18:14:15.730369 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:15.730341 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:15.960475 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:15.960445 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6"] Aug 04 18:14:15.960670 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:15.960631 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" containerID="cri-o://09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2" gracePeriod=30 Aug 04 18:14:20.729265 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:20.729219 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:14:25.728838 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:25.728799 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:14:30.728939 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:30.728901 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:14:30.729396 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:30.728999 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:35.729038 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:35.728997 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:14:40.728586 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:40.728544 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:14:45.728499 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:45.728456 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:14:46.595782 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.595757 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:46.654417 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.654386 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a89ada0-532c-4595-8614-7acc5ef5e706-openshift-service-ca-bundle\") pod \"9a89ada0-532c-4595-8614-7acc5ef5e706\" (UID: \"9a89ada0-532c-4595-8614-7acc5ef5e706\") " Aug 04 18:14:46.654571 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.654499 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a89ada0-532c-4595-8614-7acc5ef5e706-proxy-tls\") pod \"9a89ada0-532c-4595-8614-7acc5ef5e706\" (UID: \"9a89ada0-532c-4595-8614-7acc5ef5e706\") " Aug 04 18:14:46.654804 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.654784 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a89ada0-532c-4595-8614-7acc5ef5e706-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "9a89ada0-532c-4595-8614-7acc5ef5e706" (UID: "9a89ada0-532c-4595-8614-7acc5ef5e706"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:14:46.656569 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.656545 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a89ada0-532c-4595-8614-7acc5ef5e706-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9a89ada0-532c-4595-8614-7acc5ef5e706" (UID: "9a89ada0-532c-4595-8614-7acc5ef5e706"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:14:46.755344 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.755280 2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9a89ada0-532c-4595-8614-7acc5ef5e706-proxy-tls\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:14:46.755344 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.755305 2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a89ada0-532c-4595-8614-7acc5ef5e706-openshift-service-ca-bundle\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:14:46.880805 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.880774 2583 generic.go:356] "Generic (PLEG): container finished" podID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerID="09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2" exitCode=0 Aug 04 18:14:46.880953 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.880815 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" Aug 04 18:14:46.880953 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.880837 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" event={"ID":"9a89ada0-532c-4595-8614-7acc5ef5e706","Type":"ContainerDied","Data":"09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2"} Aug 04 18:14:46.880953 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.880876 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6" event={"ID":"9a89ada0-532c-4595-8614-7acc5ef5e706","Type":"ContainerDied","Data":"75da4372abf1726af7235aa496261611e8dfdf16b6f666644a465acafadeccb7"} Aug 04 18:14:46.880953 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.880897 2583 scope.go:117] "RemoveContainer" containerID="09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2" Aug 04 18:14:46.890083 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.890065 2583 scope.go:117] "RemoveContainer" containerID="09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2" Aug 04 18:14:46.890349 ip-10-0-128-51 kubenswrapper[2583]: E0804 18:14:46.890330 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2\": container with ID starting with 09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2 not found: ID does not exist" containerID="09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2" Aug 04 18:14:46.890395 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.890357 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2"} err="failed to get container status \"09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2\": rpc error: code = NotFound desc = could not find container \"09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2\": container with ID starting with 09ec8a4996ffbf31a9fc1f78f4cfa75aee61b8a66d10c328f6629d12e6cdb6a2 not found: ID does not exist" Aug 04 18:14:46.903002 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.902982 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6"] Aug 04 18:14:46.907865 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:46.907846 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-c55f6-75bdf6dd64-8zxl6"] Aug 04 18:14:48.156236 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:14:48.156206 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" path="/var/lib/kubelet/pods/9a89ada0-532c-4595-8614-7acc5ef5e706/volumes" Aug 04 18:15:04.085668 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:04.085595 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:15:04.086048 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:04.085697 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:15:56.216255 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.216223 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm"] Aug 04 18:15:56.216715 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.216593 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" Aug 04 18:15:56.216715 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.216606 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" Aug 04 18:15:56.216715 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.216666 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a89ada0-532c-4595-8614-7acc5ef5e706" containerName="model-chainer-raw-c55f6" Aug 04 18:15:56.219667 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.219643 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:15:56.229028 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.229007 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-99f90-kube-rbac-proxy-sar-config\"" Aug 04 18:15:56.229028 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.229033 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Aug 04 18:15:56.229214 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.229009 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-99f90-serving-cert\"" Aug 04 18:15:56.229321 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.229306 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vsp4f\"" Aug 04 18:15:56.237829 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.237809 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm"] Aug 04 18:15:56.320776 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.320744 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6682b73c-c437-44ef-b572-771401b372f0-proxy-tls\") pod \"model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm\" (UID: \"6682b73c-c437-44ef-b572-771401b372f0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:15:56.320776 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.320777 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6682b73c-c437-44ef-b572-771401b372f0-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm\" (UID: \"6682b73c-c437-44ef-b572-771401b372f0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:15:56.421336 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.421296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6682b73c-c437-44ef-b572-771401b372f0-proxy-tls\") pod \"model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm\" (UID: \"6682b73c-c437-44ef-b572-771401b372f0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:15:56.421336 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.421340 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6682b73c-c437-44ef-b572-771401b372f0-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm\" (UID: \"6682b73c-c437-44ef-b572-771401b372f0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:15:56.422067 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.422036 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6682b73c-c437-44ef-b572-771401b372f0-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm\" (UID: \"6682b73c-c437-44ef-b572-771401b372f0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:15:56.423687 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.423660 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6682b73c-c437-44ef-b572-771401b372f0-proxy-tls\") pod \"model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm\" (UID: \"6682b73c-c437-44ef-b572-771401b372f0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:15:56.530699 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.530613 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:15:56.656490 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:56.656463 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm"] Aug 04 18:15:56.658973 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:15:56.658944 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6682b73c_c437_44ef_b572_771401b372f0.slice/crio-46d617354bb865d9eee95780bb1077d4de86edf570d69663eb2312a3604b662b WatchSource:0}: Error finding container 46d617354bb865d9eee95780bb1077d4de86edf570d69663eb2312a3604b662b: Status 404 returned error can't find the container with id 46d617354bb865d9eee95780bb1077d4de86edf570d69663eb2312a3604b662b Aug 04 18:15:57.182164 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:57.182129 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" event={"ID":"6682b73c-c437-44ef-b572-771401b372f0","Type":"ContainerStarted","Data":"aa0f49e4a3020445d3d2ced4801e090f9f64f3d31d7b2951d260181ae06e61c0"} Aug 04 18:15:57.182344 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:57.182184 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" event={"ID":"6682b73c-c437-44ef-b572-771401b372f0","Type":"ContainerStarted","Data":"46d617354bb865d9eee95780bb1077d4de86edf570d69663eb2312a3604b662b"} Aug 04 18:15:57.182344 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:57.182237 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:15:57.202039 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:15:57.201990 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" podStartSLOduration=1.2019762250000001 podStartE2EDuration="1.201976225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 18:15:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:15:57.200243878 +0000 UTC m=+953.503187802" watchObservedRunningTime="2026-08-04 18:15:57.201976225 +0000 UTC m=+953.504920199" Aug 04 18:16:03.192420 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:03.192389 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:16:06.327715 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:06.327680 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm"] Aug 04 18:16:06.328102 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:06.327871 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" containerID="cri-o://aa0f49e4a3020445d3d2ced4801e090f9f64f3d31d7b2951d260181ae06e61c0" gracePeriod=30 Aug 04 18:16:08.191114 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:08.191076 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:16:13.190793 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:13.190749 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:16:18.191201 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:18.191154 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:16:18.191690 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:18.191275 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:16:23.190283 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:23.190236 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:16:28.190780 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:28.190694 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:16:33.191290 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:33.191251 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 04 18:16:36.352733 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:36.352706 2583 generic.go:356] "Generic (PLEG): container finished" podID="6682b73c-c437-44ef-b572-771401b372f0" containerID="aa0f49e4a3020445d3d2ced4801e090f9f64f3d31d7b2951d260181ae06e61c0" exitCode=0 Aug 04 18:16:36.353002 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:36.352775 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" event={"ID":"6682b73c-c437-44ef-b572-771401b372f0","Type":"ContainerDied","Data":"aa0f49e4a3020445d3d2ced4801e090f9f64f3d31d7b2951d260181ae06e61c0"} Aug 04 18:16:36.464816 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:36.464791 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:16:36.546591 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:36.546566 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6682b73c-c437-44ef-b572-771401b372f0-openshift-service-ca-bundle\") pod \"6682b73c-c437-44ef-b572-771401b372f0\" (UID: \"6682b73c-c437-44ef-b572-771401b372f0\") " Aug 04 18:16:36.546722 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:36.546617 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6682b73c-c437-44ef-b572-771401b372f0-proxy-tls\") pod \"6682b73c-c437-44ef-b572-771401b372f0\" (UID: \"6682b73c-c437-44ef-b572-771401b372f0\") " Aug 04 18:16:36.546888 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:36.546865 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6682b73c-c437-44ef-b572-771401b372f0-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6682b73c-c437-44ef-b572-771401b372f0" (UID: "6682b73c-c437-44ef-b572-771401b372f0"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 04 18:16:36.548462 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:36.548444 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6682b73c-c437-44ef-b572-771401b372f0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6682b73c-c437-44ef-b572-771401b372f0" (UID: "6682b73c-c437-44ef-b572-771401b372f0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 04 18:16:36.647221 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:36.647182 2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6682b73c-c437-44ef-b572-771401b372f0-proxy-tls\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:16:36.647221 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:36.647220 2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6682b73c-c437-44ef-b572-771401b372f0-openshift-service-ca-bundle\") on node \"ip-10-0-128-51.ec2.internal\" DevicePath \"\"" Aug 04 18:16:37.358058 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:37.358025 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" event={"ID":"6682b73c-c437-44ef-b572-771401b372f0","Type":"ContainerDied","Data":"46d617354bb865d9eee95780bb1077d4de86edf570d69663eb2312a3604b662b"} Aug 04 18:16:37.358535 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:37.358058 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm" Aug 04 18:16:37.358535 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:37.358092 2583 scope.go:117] "RemoveContainer" containerID="aa0f49e4a3020445d3d2ced4801e090f9f64f3d31d7b2951d260181ae06e61c0" Aug 04 18:16:37.382197 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:37.382174 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm"] Aug 04 18:16:37.387493 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:37.387469 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-99f90-6c8c9894b4-w47fm"] Aug 04 18:16:38.155499 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:16:38.155461 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6682b73c-c437-44ef-b572-771401b372f0" path="/var/lib/kubelet/pods/6682b73c-c437-44ef-b572-771401b372f0/volumes" Aug 04 18:20:04.112277 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:20:04.112245 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:20:04.113015 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:20:04.112999 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:25:04.139457 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:25:04.139427 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:25:04.139963 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:25:04.139465 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:27:10.996035 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:10.995965 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w8bqx_ab7a4076-baf9-4296-a630-843220f1341c/global-pull-secret-syncer/0.log" Aug 04 18:27:11.109305 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:11.109274 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qprpr_a5d518ae-f261-4144-9854-a18ba566698e/konnectivity-agent/0.log" Aug 04 18:27:11.129706 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:11.129678 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-51.ec2.internal_c82be4bfc3f07367942d8a0fb59c52b4/haproxy/0.log" Aug 04 18:27:15.063976 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.063948 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df60301f-42f3-49b6-9b5f-586a36520202/alertmanager/0.log" Aug 04 18:27:15.089700 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.089675 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df60301f-42f3-49b6-9b5f-586a36520202/config-reloader/0.log" Aug 04 18:27:15.119125 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.119097 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df60301f-42f3-49b6-9b5f-586a36520202/kube-rbac-proxy-web/0.log" Aug 04 18:27:15.149922 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.149894 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df60301f-42f3-49b6-9b5f-586a36520202/kube-rbac-proxy/0.log" Aug 04 18:27:15.178992 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.178968 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df60301f-42f3-49b6-9b5f-586a36520202/kube-rbac-proxy-metric/0.log" Aug 04 18:27:15.206727 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.206707 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df60301f-42f3-49b6-9b5f-586a36520202/prom-label-proxy/0.log" Aug 04 18:27:15.232445 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.232424 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_df60301f-42f3-49b6-9b5f-586a36520202/init-config-reloader/0.log" Aug 04 18:27:15.274521 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.274487 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/1.log" Aug 04 18:27:15.342566 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.342494 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-cq46m_74907d13-f21b-42d4-bbb3-7707a76b3163/cluster-monitoring-operator/0.log" Aug 04 18:27:15.493042 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.493014 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-tp6qf_5f3fc7b1-af98-46d3-b1ef-4ccba5fa5cf6/monitoring-plugin/0.log" Aug 04 18:27:15.541194 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.541171 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fg4zb_30f0604d-7979-4432-b522-c5165050853b/node-exporter/0.log" Aug 04 18:27:15.568691 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.568663 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fg4zb_30f0604d-7979-4432-b522-c5165050853b/kube-rbac-proxy/0.log" Aug 04 18:27:15.593841 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.593768 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fg4zb_30f0604d-7979-4432-b522-c5165050853b/init-textfile/0.log" Aug 04 18:27:15.809639 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.809614 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-g6zzp_9e16d20a-4350-4a9c-93b2-fd095fb9aa97/kube-rbac-proxy-main/0.log" Aug 04 18:27:15.836164 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.836139 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-g6zzp_9e16d20a-4350-4a9c-93b2-fd095fb9aa97/kube-rbac-proxy-self/0.log" Aug 04 18:27:15.866779 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:15.866756 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-g6zzp_9e16d20a-4350-4a9c-93b2-fd095fb9aa97/openshift-state-metrics/0.log" Aug 04 18:27:16.268924 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:16.268855 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78c4cb6c88-9gsll_a8c29ddf-7656-4e28-8005-c38739080a89/telemeter-client/0.log" Aug 04 18:27:16.304497 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:16.304473 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78c4cb6c88-9gsll_a8c29ddf-7656-4e28-8005-c38739080a89/reload/0.log" Aug 04 18:27:16.332872 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:16.332849 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-78c4cb6c88-9gsll_a8c29ddf-7656-4e28-8005-c38739080a89/kube-rbac-proxy/0.log" Aug 04 18:27:16.380789 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:16.380767 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744877fb47-hdnzh_6ebf936c-9776-4ee9-9e09-007659ac3fd3/thanos-query/0.log" Aug 04 18:27:16.418333 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:16.418309 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744877fb47-hdnzh_6ebf936c-9776-4ee9-9e09-007659ac3fd3/kube-rbac-proxy-web/0.log" Aug 04 18:27:16.456107 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:16.456089 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744877fb47-hdnzh_6ebf936c-9776-4ee9-9e09-007659ac3fd3/kube-rbac-proxy/0.log" Aug 04 18:27:16.485640 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:16.485614 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744877fb47-hdnzh_6ebf936c-9776-4ee9-9e09-007659ac3fd3/prom-label-proxy/0.log" Aug 04 18:27:16.533865 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:16.533809 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744877fb47-hdnzh_6ebf936c-9776-4ee9-9e09-007659ac3fd3/kube-rbac-proxy-rules/0.log" Aug 04 18:27:16.561349 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:16.561326 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-744877fb47-hdnzh_6ebf936c-9776-4ee9-9e09-007659ac3fd3/kube-rbac-proxy-metrics/0.log" Aug 04 18:27:17.708215 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:17.708189 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-5zmkk_d9060763-2b35-457a-879d-648b1cec246d/networking-console-plugin/0.log" Aug 04 18:27:18.634615 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.634539 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw"] Aug 04 18:27:18.637149 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.635398 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" Aug 04 18:27:18.637149 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.635424 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" Aug 04 18:27:18.637149 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.635613 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6682b73c-c437-44ef-b572-771401b372f0" containerName="model-chainer-raw-hpa-99f90" Aug 04 18:27:18.639447 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.639425 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.641703 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.641683 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flh2v\"/\"openshift-service-ca.crt\"" Aug 04 18:27:18.641819 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.641686 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flh2v\"/\"kube-root-ca.crt\"" Aug 04 18:27:18.642417 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.642401 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-flh2v\"/\"default-dockercfg-g5r45\"" Aug 04 18:27:18.649987 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.649963 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw"] Aug 04 18:27:18.675696 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.675671 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sjjr\" (UniqueName: \"kubernetes.io/projected/55e6a7e6-2913-4843-b452-2aeab3ef3794-kube-api-access-5sjjr\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.675803 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.675716 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-lib-modules\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.675803 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.675793 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-sys\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.675883 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.675826 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-proc\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.675883 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.675844 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-podres\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.696692 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.696672 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-767b58899d-lm6gq_757c4d5a-26ce-4546-a39c-ddf49480ffd8/console/0.log" Aug 04 18:27:18.776804 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.776776 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sjjr\" (UniqueName: \"kubernetes.io/projected/55e6a7e6-2913-4843-b452-2aeab3ef3794-kube-api-access-5sjjr\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.777143 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.776821 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-lib-modules\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.777143 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.776857 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-sys\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.777143 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.776877 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-proc\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.777143 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.776892 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-podres\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.777143 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.776964 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-sys\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.777143 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.776995 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-proc\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.777143 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.777006 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-podres\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.777143 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.777021 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55e6a7e6-2913-4843-b452-2aeab3ef3794-lib-modules\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.785219 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.785193 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sjjr\" (UniqueName: \"kubernetes.io/projected/55e6a7e6-2913-4843-b452-2aeab3ef3794-kube-api-access-5sjjr\") pod \"perf-node-gather-daemonset-p22lw\" (UID: \"55e6a7e6-2913-4843-b452-2aeab3ef3794\") " pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:18.950115 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:18.950021 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:19.076300 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:19.076239 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw"] Aug 04 18:27:19.078540 ip-10-0-128-51 kubenswrapper[2583]: W0804 18:27:19.078513 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod55e6a7e6_2913_4843_b452_2aeab3ef3794.slice/crio-3c2ce4f7ddde8c41d589bb43fb6f2b19b964536df028f933a5267b297ae4bada WatchSource:0}: Error finding container 3c2ce4f7ddde8c41d589bb43fb6f2b19b964536df028f933a5267b297ae4bada: Status 404 returned error can't find the container with id 3c2ce4f7ddde8c41d589bb43fb6f2b19b964536df028f933a5267b297ae4bada Aug 04 18:27:19.139836 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:19.139809 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" event={"ID":"55e6a7e6-2913-4843-b452-2aeab3ef3794","Type":"ContainerStarted","Data":"3c2ce4f7ddde8c41d589bb43fb6f2b19b964536df028f933a5267b297ae4bada"} Aug 04 18:27:20.145495 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:20.145454 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" event={"ID":"55e6a7e6-2913-4843-b452-2aeab3ef3794","Type":"ContainerStarted","Data":"c272673d9c916cf265f026ab7511f667c8fab5b8f82de532430b34a402d9a3a8"} Aug 04 18:27:20.145925 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:20.145590 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:20.162307 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:20.162256 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" podStartSLOduration=2.162242559 podStartE2EDuration="2.162242559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 18:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 18:27:20.162136915 +0000 UTC m=+1636.465080841" watchObservedRunningTime="2026-08-04 18:27:20.162242559 +0000 UTC m=+1636.465186485" Aug 04 18:27:20.184116 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:20.184090 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-42kq7_d539a6c0-c527-43c8-b9b2-ae8137a4e7a8/dns/0.log" Aug 04 18:27:20.208923 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:20.208902 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-42kq7_d539a6c0-c527-43c8-b9b2-ae8137a4e7a8/kube-rbac-proxy/0.log" Aug 04 18:27:20.378518 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:20.378475 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vn24x_27c0e506-b7da-4130-acac-c0140c7a8a18/dns-node-resolver/0.log" Aug 04 18:27:20.782547 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:20.782517 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f79dc8896-zvsv9_a4fa8bfc-222e-4487-bfed-f99a3fe90afc/registry/0.log" Aug 04 18:27:20.802231 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:20.802205 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n8zd2_83c7dd22-1e03-4b09-a372-2cddfbbafb32/node-ca/0.log" Aug 04 18:27:21.963477 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:21.963446 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6s7g8_940a334e-5559-4412-b378-6c59a51da197/serve-healthcheck-canary/0.log" Aug 04 18:27:22.512945 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:22.512920 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j84dm_6608edeb-3048-446d-a8fb-9c0af93b115a/kube-rbac-proxy/0.log" Aug 04 18:27:22.535340 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:22.535311 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j84dm_6608edeb-3048-446d-a8fb-9c0af93b115a/exporter/0.log" Aug 04 18:27:22.558543 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:22.558524 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j84dm_6608edeb-3048-446d-a8fb-9c0af93b115a/extractor/0.log" Aug 04 18:27:24.835802 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:24.835771 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-xln8c_ddd4cb12-cff4-4bdf-9ce0-70fc4a8100b6/manager/0.log" Aug 04 18:27:24.857936 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:24.857913 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-x9tx2_84e89d1a-e266-4cd6-a7f2-fab34faeca3b/server/0.log" Aug 04 18:27:25.070491 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:25.070451 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-nt7tt_488b96d0-4363-4055-a953-6511d9329e27/seaweedfs/0.log" Aug 04 18:27:26.159595 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:26.159568 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-flh2v/perf-node-gather-daemonset-p22lw" Aug 04 18:27:30.626711 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:30.626681 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8bjfh_d8db9569-f0a2-47f8-a876-839d7dcbfdab/kube-multus/0.log" Aug 04 18:27:30.980276 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:30.980201 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nwkj_836f56fd-94e7-4229-9744-eddcf05a40fd/kube-multus-additional-cni-plugins/0.log" Aug 04 18:27:31.003184 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:31.003153 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nwkj_836f56fd-94e7-4229-9744-eddcf05a40fd/egress-router-binary-copy/0.log" Aug 04 18:27:31.025053 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:31.025025 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nwkj_836f56fd-94e7-4229-9744-eddcf05a40fd/cni-plugins/0.log" Aug 04 18:27:31.047264 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:31.047242 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nwkj_836f56fd-94e7-4229-9744-eddcf05a40fd/bond-cni-plugin/0.log" Aug 04 18:27:31.068952 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:31.068931 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nwkj_836f56fd-94e7-4229-9744-eddcf05a40fd/routeoverride-cni/0.log" Aug 04 18:27:31.092978 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:31.092954 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nwkj_836f56fd-94e7-4229-9744-eddcf05a40fd/whereabouts-cni-bincopy/0.log" Aug 04 18:27:31.117874 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:31.117848 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8nwkj_836f56fd-94e7-4229-9744-eddcf05a40fd/whereabouts-cni/0.log" Aug 04 18:27:31.201611 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:31.201583 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5brj6_349d54df-5bd2-4a3f-8d94-25c6ec118a46/network-metrics-daemon/0.log" Aug 04 18:27:31.222240 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:31.222220 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5brj6_349d54df-5bd2-4a3f-8d94-25c6ec118a46/kube-rbac-proxy/0.log" Aug 04 18:27:32.081292 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:32.081263 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwhtp_8edbbe9e-2d52-43b5-8098-a964b3b88df1/ovn-controller/0.log" Aug 04 18:27:32.102444 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:32.102421 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwhtp_8edbbe9e-2d52-43b5-8098-a964b3b88df1/ovn-acl-logging/0.log" Aug 04 18:27:32.125948 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:32.125921 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwhtp_8edbbe9e-2d52-43b5-8098-a964b3b88df1/kube-rbac-proxy-node/0.log" Aug 04 18:27:32.148717 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:32.148692 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwhtp_8edbbe9e-2d52-43b5-8098-a964b3b88df1/kube-rbac-proxy-ovn-metrics/0.log" Aug 04 18:27:32.170337 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:32.170313 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwhtp_8edbbe9e-2d52-43b5-8098-a964b3b88df1/northd/0.log" Aug 04 18:27:32.194421 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:32.194400 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwhtp_8edbbe9e-2d52-43b5-8098-a964b3b88df1/nbdb/0.log" Aug 04 18:27:32.217355 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:32.217305 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwhtp_8edbbe9e-2d52-43b5-8098-a964b3b88df1/sbdb/0.log" Aug 04 18:27:32.254635 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:32.254593 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dwhtp_8edbbe9e-2d52-43b5-8098-a964b3b88df1/ovnkube-controller/0.log" Aug 04 18:27:33.751584 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:33.751549 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q7ttb_ae52f154-23ed-4d15-adf7-84bc6f4e80e0/network-check-target-container/0.log" Aug 04 18:27:34.692589 ip-10-0-128-51 kubenswrapper[2583]: I0804 18:27:34.692563 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-n2dmv_20f878b7-ee83-4358-b162-228e59040a8b/iptables-alerter/0.log"