Jul 27 17:00:18.624770 ip-10-0-140-73 systemd[1]: Starting Kubernetes Kubelet... Jul 27 17:00:19.062625 ip-10-0-140-73 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 17:00:19.062625 ip-10-0-140-73 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 27 17:00:19.062625 ip-10-0-140-73 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 17:00:19.062625 ip-10-0-140-73 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 27 17:00:19.062625 ip-10-0-140-73 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 27 17:00:19.064326 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.064250 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 27 17:00:19.069757 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069744 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:00:19.069757 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069757 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069761 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069764 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069767 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069770 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069773 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069775 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069778 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069782 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069785 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069787 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069790 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069793 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069796 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069798 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069801 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069803 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069806 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069808 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069811 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:00:19.069820 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069813 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069816 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069818 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069821 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069824 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069827 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069829 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069832 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069835 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069838 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069841 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069843 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069846 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069848 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069851 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069853 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069856 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069859 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069861 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069864 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:00:19.070278 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069867 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069869 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069872 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069874 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069877 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069879 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069882 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069884 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069886 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069889 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069891 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069894 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069898 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069902 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069906 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069909 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069912 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069914 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069917 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:00:19.070770 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069919 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069924 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069927 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069930 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069933 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069936 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069938 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069941 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069943 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069945 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069948 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069951 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069954 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069957 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069959 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069962 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069965 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069967 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069969 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069972 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:00:19.071263 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069975 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069977 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069981 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069985 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069987 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069990 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069992 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069996 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.069999 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070002 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070005 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070007 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070010 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070012 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070015 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070017 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070020 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070022 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:00:19.071744 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.070024 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:00:19.072361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072348 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:00:19.072361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072360 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072365 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072368 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072371 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072374 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072377 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072380 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072384 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072386 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072389 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072392 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072394 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072397 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072399 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072401 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072404 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072406 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072409 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072411 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072414 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:00:19.072413 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072417 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072419 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072424 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072427 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072430 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072433 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072436 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072438 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072441 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072444 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072446 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072449 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072451 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072453 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072456 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072459 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072461 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072464 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072467 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072469 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:00:19.072916 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072471 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072474 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072476 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072478 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072481 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072483 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072486 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072488 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072490 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072493 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072495 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072509 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072512 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072514 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072532 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072536 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072540 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072543 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072546 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:00:19.073402 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072549 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072553 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072556 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072559 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072561 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072564 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072567 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072569 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072572 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072576 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072580 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072583 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072586 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072589 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072591 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072594 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072596 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072598 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072601 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:00:19.073889 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072604 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072607 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072609 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072611 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072614 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072616 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072619 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072621 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072624 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072626 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072629 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072632 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072634 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072636 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072639 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072641 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072644 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072646 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072649 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072651 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:00:19.074351 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072985 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072990 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072992 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072995 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.072998 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073000 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073003 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073005 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073008 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073010 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073013 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073015 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073018 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073021 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073023 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073026 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073028 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073031 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073035 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:00:19.074842 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073038 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073041 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073044 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073046 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073049 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073051 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073054 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073056 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073059 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073063 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073066 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073068 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073071 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073074 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073077 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073080 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073082 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073085 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073088 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:00:19.075290 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073091 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073093 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073096 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073098 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073100 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073103 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073105 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073108 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073110 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073113 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073115 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073117 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073120 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073122 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073125 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073128 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073131 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073133 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073135 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073138 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:00:19.075845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073141 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073143 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073145 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073148 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073150 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073152 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073155 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073158 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073162 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073164 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073167 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073170 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073173 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073175 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073177 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073180 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073182 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073184 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073187 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073189 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:00:19.076361 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073192 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073194 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073197 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073199 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073202 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073204 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073207 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073209 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073212 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073214 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073217 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073219 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073222 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073225 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073227 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073230 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073232 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073235 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073237 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073239 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:00:19.076856 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073242 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073308 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073314 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073320 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073325 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073331 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073336 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073342 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073348 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073352 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073356 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073359 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073362 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073365 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073368 2558 flags.go:64] FLAG: --cgroup-root="" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073371 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073374 2558 flags.go:64] FLAG: --client-ca-file="" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073376 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073379 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073383 2558 flags.go:64] FLAG: --cluster-domain="" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073385 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073388 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073391 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073394 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 27 17:00:19.077324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073398 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073400 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073404 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073407 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073410 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073413 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073416 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073419 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073421 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073426 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073428 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073431 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073434 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073436 2558 flags.go:64] FLAG: --enable-server="true" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073440 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073445 2558 flags.go:64] FLAG: --event-burst="100" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073448 2558 flags.go:64] FLAG: --event-qps="50" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073450 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073454 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073456 2558 flags.go:64] FLAG: --eviction-hard="" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073460 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073463 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073465 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073469 2558 flags.go:64] FLAG: --eviction-soft="" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073472 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 27 17:00:19.077917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073475 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073477 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073480 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073483 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073485 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073488 2558 flags.go:64] FLAG: --feature-gates="" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073491 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073494 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073520 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073524 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073527 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073530 2558 flags.go:64] FLAG: --help="false" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073534 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073536 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073539 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073542 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073545 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073548 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073551 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073553 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073556 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073561 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073565 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073568 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 27 17:00:19.078545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073571 2558 flags.go:64] FLAG: --kube-reserved="" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073574 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073577 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073579 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073582 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073585 2558 flags.go:64] FLAG: --lock-file="" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073587 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073590 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073593 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073598 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073601 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073604 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073606 2558 flags.go:64] FLAG: --logging-format="text" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073609 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073612 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073615 2558 flags.go:64] FLAG: --manifest-url="" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073618 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073622 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073625 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073628 2558 flags.go:64] FLAG: --max-pods="110" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073631 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073634 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073636 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073639 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073642 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 27 17:00:19.079154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073645 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073648 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073654 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073656 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073661 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073664 2558 flags.go:64] FLAG: --pod-cidr="" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073667 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073672 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073675 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073678 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073681 2558 flags.go:64] FLAG: --port="10250" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073683 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073686 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-052cb7fc1e63e36c4" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073689 2558 flags.go:64] FLAG: --qos-reserved="" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073692 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073694 2558 flags.go:64] FLAG: --register-node="true" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073697 2558 flags.go:64] FLAG: --register-with-taints="" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073700 2558 flags.go:64] FLAG: --registry-burst="10" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073703 2558 flags.go:64] FLAG: --registry-qps="5" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073706 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073708 2558 flags.go:64] FLAG: --reserved-memory="" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073711 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073714 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073717 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073720 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 27 17:00:19.079814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073723 2558 flags.go:64] FLAG: --runonce="false" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073725 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073728 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073731 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073733 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073736 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073739 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073742 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073744 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073747 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073750 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073752 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073756 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073759 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073762 2558 flags.go:64] FLAG: --system-cgroups="" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073766 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073771 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073774 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073776 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073780 2558 flags.go:64] FLAG: --tls-min-version="" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073782 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073785 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073788 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073790 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073793 2558 flags.go:64] FLAG: --v="2" Jul 27 17:00:19.080686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073796 2558 flags.go:64] FLAG: --version="false" Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073800 2558 flags.go:64] FLAG: --vmodule="" Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073803 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.073806 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073910 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073914 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073917 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073920 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073922 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073925 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073927 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073930 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073932 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073935 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073937 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073939 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073942 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073947 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073951 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073955 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:00:19.081752 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073958 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073961 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073966 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073969 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073972 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073974 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073977 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073980 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073983 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073985 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073988 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073991 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073993 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073995 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.073998 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074000 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074003 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074005 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074008 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:00:19.082578 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074010 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074014 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074017 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074020 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074022 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074025 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074027 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074030 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074033 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074035 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074037 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074040 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074044 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074047 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074049 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074053 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074058 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074061 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074063 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074066 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:00:19.083397 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074068 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074071 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074073 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074075 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074078 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074080 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074083 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074085 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074088 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074090 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074092 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074095 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074097 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074100 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074102 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074104 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074107 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074109 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074112 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074114 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:00:19.084137 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074117 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074119 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074121 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074124 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074128 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074130 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074133 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074136 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074139 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074142 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074144 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074147 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074149 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074151 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074155 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074159 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074162 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074165 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074168 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074170 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:00:19.084839 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074173 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074176 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074178 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.074181 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.075071 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.082283 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.082299 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.082319 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.082332 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082418 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082426 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082431 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082436 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082441 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:00:19.085660 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082446 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082453 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082459 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082464 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082468 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082473 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082477 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082483 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082488 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082492 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082524 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082529 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082533 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082540 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082546 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082551 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082557 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082561 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082566 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:00:19.086215 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082571 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082575 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082579 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082583 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082588 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082592 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082596 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082600 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082604 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082608 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082612 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082616 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082620 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082625 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082629 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082633 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082637 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082641 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082645 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082649 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:00:19.086796 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082653 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082658 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082663 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082667 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082671 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082675 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082679 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082683 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082687 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082691 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082695 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082699 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082703 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082707 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082711 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082715 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082720 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082724 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082729 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082733 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:00:19.087273 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082737 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082740 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082744 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082748 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082753 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082757 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082761 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082765 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082769 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082773 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082777 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082781 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082785 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082789 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082797 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082802 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082807 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082811 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082815 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:00:19.087801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082819 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082823 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082828 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082832 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082836 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082840 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082844 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082848 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082853 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082857 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082861 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082865 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082870 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082874 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082878 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:00:19.088260 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.082882 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.082890 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083067 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083075 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083080 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083084 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083088 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083092 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083096 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083100 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083104 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083108 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083113 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083118 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083122 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 27 17:00:19.088711 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083126 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083130 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083135 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083139 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083143 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083148 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083152 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083156 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083160 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083164 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083169 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083173 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083177 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083181 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083185 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083189 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083193 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083197 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083202 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083206 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 27 17:00:19.089072 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083210 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083214 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083219 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083223 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083227 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083231 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083235 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083239 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083243 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083247 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083251 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083256 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083260 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083263 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083267 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083272 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083276 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083280 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083284 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083288 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 27 17:00:19.089581 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083292 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083297 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083301 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083304 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083308 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083312 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083316 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083320 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083324 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083328 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083332 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083339 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083344 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083348 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083353 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083357 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083361 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083365 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083368 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 27 17:00:19.090053 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083372 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083377 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083381 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083385 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083389 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083394 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083397 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083401 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083405 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083409 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083412 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083416 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083420 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083424 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083428 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083432 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083438 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083445 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083449 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 27 17:00:19.090514 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083453 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083457 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083463 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083468 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083473 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083477 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083482 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:19.083486 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.083494 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.083629 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.087944 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.089523 2558 server.go:1019] "Starting client certificate rotation" Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.089618 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 17:00:19.091001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.089656 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 27 17:00:19.092170 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.092157 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 17:00:19.095009 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.094994 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 27 17:00:19.110638 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.110622 2558 log.go:25] "Validated CRI v1 runtime API" Jul 27 17:00:19.113025 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.113002 2558 log.go:25] "Validated CRI v1 image API" Jul 27 17:00:19.114920 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.114897 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 27 17:00:19.119765 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.119745 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 17:00:19.120268 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.120251 2558 fs.go:135] Filesystem UUIDs: map[1c95615a-d046-46eb-a991-227ee7f407d1:/dev/nvme0n1p4 2eef0da1-90dd-485a-b160-a4d8bfe84b22:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 27 17:00:19.120315 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.120269 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 27 17:00:19.126312 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.126211 2558 manager.go:216] Machine: {Timestamp:2026-07-27 17:00:19.123805063 +0000 UTC m=+0.372441541 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3195000 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fdeedf72c88fc1d0333a9782db6e1 SystemUUID:ec2fdeed-f72c-88fc-1d03-33a9782db6e1 BootID:74522227-a99c-44aa-a07d-83d5b12d818b Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ef:23:bb:93:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ef:23:bb:93:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:dc:9f:ce:ab:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 27 17:00:19.126312 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.126306 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 27 17:00:19.126418 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.126368 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 27 17:00:19.129812 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.129785 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 27 17:00:19.129939 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.129817 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 27 17:00:19.130865 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.130629 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 27 17:00:19.130865 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.130639 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 27 17:00:19.130865 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.130650 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 17:00:19.132323 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.132310 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 27 17:00:19.133603 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.133593 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 27 17:00:19.136429 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.136418 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 27 17:00:19.136560 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.136550 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 27 17:00:19.136600 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.136580 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 27 17:00:19.136600 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.136593 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 27 17:00:19.136656 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.136615 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 27 17:00:19.136656 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.136628 2558 kubelet.go:398] "Adding apiserver pod source" Jul 27 17:00:19.136656 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.136640 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 27 17:00:19.136975 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.136963 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 17:00:19.137014 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.136982 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 27 17:00:19.145334 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.145135 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 27 17:00:19.147745 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.147731 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 27 17:00:19.147792 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.147762 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 27 17:00:19.149828 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149817 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 27 17:00:19.149869 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149833 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 27 17:00:19.149869 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149840 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 27 17:00:19.149869 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149845 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 27 17:00:19.149869 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149855 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 27 17:00:19.149869 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149863 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 27 17:00:19.150001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149872 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 27 17:00:19.150001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149877 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 27 17:00:19.150001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149884 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 27 17:00:19.150001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149889 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 27 17:00:19.150001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149896 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 27 17:00:19.150001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149901 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 27 17:00:19.150001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149925 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 27 17:00:19.150001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.149933 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 27 17:00:19.153149 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.153135 2558 server.go:1268] "Started kubelet" Jul 27 17:00:19.153318 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.153254 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 27 17:00:19.153318 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.153302 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 27 17:00:19.153455 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.153335 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 27 17:00:19.153530 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.153469 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 27 17:00:19.153826 ip-10-0-140-73 systemd[1]: Started Kubernetes Kubelet. Jul 27 17:00:19.154342 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.154226 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 27 17:00:19.154342 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.154229 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 27 17:00:19.154540 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.154393 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 27 17:00:19.155337 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.155320 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 27 17:00:19.159231 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.159201 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 27 17:00:19.162745 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.161609 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-73.ec2.internal.18c634211ebadd66 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-73.ec2.internal,UID:ip-10-0-140-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-73.ec2.internal,},FirstTimestamp:2026-07-27 17:00:19.153108326 +0000 UTC m=+0.401744805,LastTimestamp:2026-07-27 17:00:19.153108326 +0000 UTC m=+0.401744805,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-73.ec2.internal,}" Jul 27 17:00:19.164616 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.164602 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 27 17:00:19.164674 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.164606 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 27 17:00:19.164757 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.164742 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:19.165396 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165379 2558 factory.go:55] Registering systemd factory Jul 27 17:00:19.165482 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165395 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 27 17:00:19.165482 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165402 2558 factory.go:223] Registration of the systemd container factory successfully Jul 27 17:00:19.165482 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165427 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 27 17:00:19.165482 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165440 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 27 17:00:19.165684 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165538 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 27 17:00:19.165684 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165545 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 27 17:00:19.165684 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165672 2558 factory.go:153] Registering CRI-O factory Jul 27 17:00:19.165684 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165684 2558 factory.go:223] Registration of the crio container factory successfully Jul 27 17:00:19.165865 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165732 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 27 17:00:19.165865 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165750 2558 factory.go:103] Registering Raw factory Jul 27 17:00:19.165865 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.165763 2558 manager.go:1196] Started watching for new ooms in manager Jul 27 17:00:19.166067 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.166046 2558 manager.go:349] Starting recovery of all containers Jul 27 17:00:19.166287 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.166256 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 27 17:00:19.166397 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.166376 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 27 17:00:19.175799 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.175778 2558 manager.go:354] Recovery completed Jul 27 17:00:19.176536 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.176486 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6lrj9" Jul 27 17:00:19.180977 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.180962 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:00:19.182852 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.182839 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:00:19.182910 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.182867 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:00:19.182910 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.182876 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:00:19.183356 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.183342 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 27 17:00:19.183356 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.183355 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 27 17:00:19.183467 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.183368 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:00:19.183467 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.183372 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 27 17:00:19.183988 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.183975 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:00:19.184025 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.184001 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:00:19.184025 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.184013 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:00:19.184217 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.184200 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6lrj9" Jul 27 17:00:19.186258 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.186243 2558 policy_none.go:49] "None policy: Start" Jul 27 17:00:19.186258 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.186259 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 27 17:00:19.186356 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.186269 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 27 17:00:19.188190 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.188179 2558 policy_none.go:47] "Start" Jul 27 17:00:19.190277 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.190202 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-73.ec2.internal.18c634212080bf67 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-73.ec2.internal,UID:ip-10-0-140-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-73.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-73.ec2.internal,},FirstTimestamp:2026-07-27 17:00:19.182853991 +0000 UTC m=+0.431490469,LastTimestamp:2026-07-27 17:00:19.182853991 +0000 UTC m=+0.431490469,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-73.ec2.internal,}" Jul 27 17:00:19.223196 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.223089 2558 manager.go:337] "Starting Device Plugin manager" Jul 27 17:00:19.223273 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.223234 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 27 17:00:19.223273 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.223248 2558 server.go:87] "Starting device plugin registration server" Jul 27 17:00:19.223443 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.223432 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 27 17:00:19.223515 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.223443 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 27 17:00:19.223592 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.223579 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 27 17:00:19.223729 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.223713 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 27 17:00:19.223729 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.223725 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 27 17:00:19.224090 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.224067 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 27 17:00:19.224173 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.224127 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:19.240235 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.240216 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 27 17:00:19.250456 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.241409 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 27 17:00:19.250456 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.241461 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 27 17:00:19.250456 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.241482 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 27 17:00:19.250456 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.241544 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 27 17:00:19.250456 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.243983 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:00:19.324193 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.324149 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:00:19.324941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.324921 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:00:19.324990 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.324946 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:00:19.324990 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.324956 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:00:19.324990 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.324980 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.334496 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.334482 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.334576 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.334514 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-73.ec2.internal\": node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:19.342161 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.342139 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal"] Jul 27 17:00:19.342244 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.342203 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:00:19.342878 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.342863 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:00:19.342961 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.342894 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:00:19.342961 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.342909 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:00:19.345058 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.345043 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:00:19.345166 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.345151 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.345209 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.345179 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:00:19.345707 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.345691 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:00:19.345771 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.345730 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:00:19.345771 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.345740 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:00:19.345833 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.345696 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:00:19.345833 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.345793 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:00:19.345833 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.345806 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:00:19.347937 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.347924 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.347981 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.347948 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 27 17:00:19.348613 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.348599 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientMemory" Jul 27 17:00:19.348689 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.348625 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 27 17:00:19.348689 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.348636 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeHasSufficientPID" Jul 27 17:00:19.365606 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.365583 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:19.366101 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.366082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2765500e3b6ee453220e06c841f29167-config\") pod \"kube-apiserver-proxy-ip-10-0-140-73.ec2.internal\" (UID: \"2765500e3b6ee453220e06c841f29167\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.366174 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.366115 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/057e9c75ccfc3d58f1d145dcbffdeca7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal\" (UID: \"057e9c75ccfc3d58f1d145dcbffdeca7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.366174 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.366144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/057e9c75ccfc3d58f1d145dcbffdeca7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal\" (UID: \"057e9c75ccfc3d58f1d145dcbffdeca7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.366174 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.366158 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-73.ec2.internal\" not found" node="ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.370448 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.370434 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-73.ec2.internal\" not found" node="ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.465783 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.465759 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:19.466908 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.466892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/057e9c75ccfc3d58f1d145dcbffdeca7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal\" (UID: \"057e9c75ccfc3d58f1d145dcbffdeca7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.466982 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.466925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/057e9c75ccfc3d58f1d145dcbffdeca7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal\" (UID: \"057e9c75ccfc3d58f1d145dcbffdeca7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.466982 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.466934 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/057e9c75ccfc3d58f1d145dcbffdeca7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal\" (UID: \"057e9c75ccfc3d58f1d145dcbffdeca7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.466982 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.466949 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2765500e3b6ee453220e06c841f29167-config\") pod \"kube-apiserver-proxy-ip-10-0-140-73.ec2.internal\" (UID: \"2765500e3b6ee453220e06c841f29167\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.466982 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.466980 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/057e9c75ccfc3d58f1d145dcbffdeca7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal\" (UID: \"057e9c75ccfc3d58f1d145dcbffdeca7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.467119 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.466995 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2765500e3b6ee453220e06c841f29167-config\") pod \"kube-apiserver-proxy-ip-10-0-140-73.ec2.internal\" (UID: \"2765500e3b6ee453220e06c841f29167\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.566185 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.566154 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:19.666844 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.666795 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:19.669983 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.669970 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.675251 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:19.675226 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" Jul 27 17:00:19.767372 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.767348 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:19.867766 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.867746 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:19.968315 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:19.968256 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:20.068790 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:20.068756 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:20.088975 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.088956 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 27 17:00:20.089100 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.089080 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 27 17:00:20.169439 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:20.169413 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-73.ec2.internal\" not found" Jul 27 17:00:20.178481 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.178464 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:00:20.190697 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.190672 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 16:55:19 +0000 UTC" deadline="2028-03-03 14:10:11.811680391 +0000 UTC" Jul 27 17:00:20.190697 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.190696 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14037h9m51.620987166s" Jul 27 17:00:20.252868 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:20.252844 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2765500e3b6ee453220e06c841f29167.slice/crio-b425d55a6500fb81f8d62b557926c2b8a1d2037b06e6134e3981ca0c1ec0d58c WatchSource:0}: Error finding container b425d55a6500fb81f8d62b557926c2b8a1d2037b06e6134e3981ca0c1ec0d58c: Status 404 returned error can't find the container with id b425d55a6500fb81f8d62b557926c2b8a1d2037b06e6134e3981ca0c1ec0d58c Jul 27 17:00:20.257790 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.257776 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 17:00:20.265161 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.265147 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" Jul 27 17:00:20.278790 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.278775 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 17:00:20.280931 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.280917 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal" Jul 27 17:00:20.289397 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.289380 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 27 17:00:20.308887 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.308870 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:00:20.370619 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:20.370596 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057e9c75ccfc3d58f1d145dcbffdeca7.slice/crio-5a4cff263f002aa570f7944fee26b34ce0621947fb5046d99057fb5aa95eba1a WatchSource:0}: Error finding container 5a4cff263f002aa570f7944fee26b34ce0621947fb5046d99057fb5aa95eba1a: Status 404 returned error can't find the container with id 5a4cff263f002aa570f7944fee26b34ce0621947fb5046d99057fb5aa95eba1a Jul 27 17:00:20.723381 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:20.723318 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:00:21.038805 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.038724 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 27 17:00:21.138147 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.138024 2558 apiserver.go:52] "Watching apiserver" Jul 27 17:00:21.145994 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.145953 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 27 17:00:21.146561 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.146527 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-dbqn7","openshift-ovn-kubernetes/ovnkube-node-ccmz8","kube-system/global-pull-secret-syncer-m8xpw","kube-system/konnectivity-agent-pk9f8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv","openshift-cluster-node-tuning-operator/tuned-hsfg8","openshift-image-registry/node-ca-k9z9x","openshift-multus/multus-additional-cni-plugins-4cg26","openshift-multus/multus-zpjxn","openshift-multus/network-metrics-daemon-sv2m2","kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal","openshift-dns/node-resolver-r6s2z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal","openshift-network-diagnostics/network-check-target-fzxxj"] Jul 27 17:00:21.149327 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.149302 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:21.149442 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.149390 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:21.151843 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.151823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.155079 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.154877 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 27 17:00:21.155079 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.154909 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 27 17:00:21.155079 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.154909 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 27 17:00:21.155079 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.155074 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p6jsg\"" Jul 27 17:00:21.155360 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.155231 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.156896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.156871 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.158281 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.158256 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 27 17:00:21.158740 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.158719 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 27 17:00:21.158964 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.158946 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 27 17:00:21.159319 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.159296 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.159989 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.159767 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 27 17:00:21.159989 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.159781 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pdkl7\"" Jul 27 17:00:21.160379 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.160359 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 27 17:00:21.160379 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.160371 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 27 17:00:21.160494 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.160390 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 27 17:00:21.160494 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.160414 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 27 17:00:21.160494 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.160366 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 27 17:00:21.161096 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.161066 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s7xwq\"" Jul 27 17:00:21.162134 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.162112 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h7pfr\"" Jul 27 17:00:21.162231 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.162200 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 27 17:00:21.162344 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.162331 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.162380 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.162339 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 27 17:00:21.164984 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.164965 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 27 17:00:21.165221 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.165206 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rmsq8\"" Jul 27 17:00:21.165480 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.165464 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 27 17:00:21.165768 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.165753 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 27 17:00:21.166047 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.166027 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 27 17:00:21.166686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.166662 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 27 17:00:21.166788 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.166704 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:21.167840 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.167445 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.167840 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.167603 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:21.169190 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.169163 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 27 17:00:21.170627 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.169964 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.175802 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.175775 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jb8ww\"" Jul 27 17:00:21.175974 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.175776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-run-netns\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.176062 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.175988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-etc-selinux\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.176062 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-cnibin\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.176062 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:21.176062 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176053 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-cni-dir\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.176189 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176080 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-os-release\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.176189 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176099 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-hostroot\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.176189 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-sysconfig\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.176189 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176143 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-var-lib-kubelet\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.176189 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-tuned\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.176383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9347cd5-f0c6-452e-8506-9c8ccb162e67-tmp\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.176383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-sys-fs\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.176383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176254 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0e3a68f-bcfd-4f6a-9663-a60146e7b64a-host\") pod \"node-ca-k9z9x\" (UID: \"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a\") " pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.176383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176280 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-modprobe-d\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.176383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-kubernetes\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.176383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-lib-modules\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.176383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e726e51d-787e-4b3f-b003-ad105dd69b3e-dbus\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.176694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-device-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.176694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176429 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-conf-dir\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.176694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.176694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176504 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-sys\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.176694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9cb9335e-07d6-4137-9f3a-51fb0413751f-konnectivity-ca\") pod \"konnectivity-agent-pk9f8\" (UID: \"9cb9335e-07d6-4137-9f3a-51fb0413751f\") " pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:21.176694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e726e51d-787e-4b3f-b003-ad105dd69b3e-kubelet-config\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.176694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176616 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-var-lib-openvswitch\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.176694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-run-openvswitch\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.176694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176681 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-run-k8s-cni-cncf-io\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176708 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-var-lib-cni-multus\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f7zr\" (UniqueName: \"kubernetes.io/projected/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-kube-api-access-7f7zr\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-ovnkube-script-lib\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176803 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-kubelet\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-node-log\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-socket-dir-parent\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176908 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-socket-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-etc-openvswitch\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.176988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-var-lib-kubelet\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9gt2\" (UniqueName: \"kubernetes.io/projected/c32310eb-1b04-49f8-b512-e509d8f2d862-kube-api-access-c9gt2\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-systemd\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177091 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdqnt\" (UniqueName: \"kubernetes.io/projected/b9347cd5-f0c6-452e-8506-9c8ccb162e67-kube-api-access-wdqnt\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-slash\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177160 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177149 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9cb9335e-07d6-4137-9f3a-51fb0413751f-agent-certs\") pod \"konnectivity-agent-pk9f8\" (UID: \"9cb9335e-07d6-4137-9f3a-51fb0413751f\") " pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177215 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-ovnkube-config\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-ovn-node-metrics-cert\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c32310eb-1b04-49f8-b512-e509d8f2d862-cni-binary-copy\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-var-lib-cni-bin\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-etc-kubernetes\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-log-socket\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177420 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-env-overrides\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxtqn\" (UniqueName: \"kubernetes.io/projected/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-kube-api-access-gxtqn\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:21.177896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.177627 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178076 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178180 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cw5ct\"" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178188 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmz8c\" (UniqueName: \"kubernetes.io/projected/c0e3a68f-bcfd-4f6a-9663-a60146e7b64a-kube-api-access-zmz8c\") pod \"node-ca-k9z9x\" (UID: \"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a\") " pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.178210 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-daemon-config\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0e3a68f-bcfd-4f6a-9663-a60146e7b64a-serviceca\") pod \"node-ca-k9z9x\" (UID: \"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a\") " pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178328 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178336 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.178412 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-registration-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-cni-bin\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178517 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178414 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178559 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-cni-netd\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-system-cni-dir\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178767 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-systemd-units\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-run-systemd\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-run-ovn\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178923 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzph5\" (UniqueName: \"kubernetes.io/projected/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-kube-api-access-zzph5\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.179005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.178973 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-run-netns\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.179553 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.179011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-host\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.180303 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.179138 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-run-multus-certs\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.180414 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.180341 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-sysctl-d\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.180414 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.180383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-sysctl-conf\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.180525 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.180417 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-run\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.181154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.181081 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 27 17:00:21.181458 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.181439 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 27 17:00:21.181570 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.181538 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 27 17:00:21.181676 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.181448 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2gq5b\"" Jul 27 17:00:21.181842 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.181825 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 27 17:00:21.181917 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.181867 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gtwc8\"" Jul 27 17:00:21.184334 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.184299 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 27 17:00:21.202736 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.202710 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-km5hx" Jul 27 17:00:21.209105 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.209080 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-km5hx" Jul 27 17:00:21.246723 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.246675 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" event={"ID":"057e9c75ccfc3d58f1d145dcbffdeca7","Type":"ContainerStarted","Data":"5a4cff263f002aa570f7944fee26b34ce0621947fb5046d99057fb5aa95eba1a"} Jul 27 17:00:21.247999 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.247977 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal" event={"ID":"2765500e3b6ee453220e06c841f29167","Type":"ContainerStarted","Data":"b425d55a6500fb81f8d62b557926c2b8a1d2037b06e6134e3981ca0c1ec0d58c"} Jul 27 17:00:21.266639 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.266620 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 27 17:00:21.281335 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.281310 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-system-cni-dir\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.281454 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.281350 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-cnibin\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.281454 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.281379 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3155d2f3-4f29-4286-822a-c219199aa133-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.281454 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.281429 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-daemon-config\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.281454 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.281448 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0e3a68f-bcfd-4f6a-9663-a60146e7b64a-serviceca\") pod \"node-ca-k9z9x\" (UID: \"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a\") " pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.281627 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.281464 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.281627 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.281562 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.281971 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.281945 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c0e3a68f-bcfd-4f6a-9663-a60146e7b64a-serviceca\") pod \"node-ca-k9z9x\" (UID: \"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a\") " pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.282055 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-registration-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.282055 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-cni-bin\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282158 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-cni-netd\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282158 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282158 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-system-cni-dir\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.282158 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282143 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-daemon-config\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-systemd-units\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-run-systemd\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-run-ovn\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzph5\" (UniqueName: \"kubernetes.io/projected/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-kube-api-access-zzph5\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282247 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-registration-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282251 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-run-netns\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282277 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-run-netns\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282279 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-host\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282305 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-run-multus-certs\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282320 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-host\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282338 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-sysctl-d\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.282352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-sysctl-conf\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282364 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-cni-bin\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282371 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-run\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282390 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qwzz\" (UniqueName: \"kubernetes.io/projected/2e47f535-d51d-4a76-a64d-0fe4d83316fa-kube-api-access-6qwzz\") pod \"node-resolver-r6s2z\" (UID: \"2e47f535-d51d-4a76-a64d-0fe4d83316fa\") " pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282400 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-cni-netd\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns87l\" (UniqueName: \"kubernetes.io/projected/3155d2f3-4f29-4286-822a-c219199aa133-kube-api-access-ns87l\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282425 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-run-netns\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282435 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282442 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-etc-selinux\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282478 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-run-systemd\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282196 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-systemd-units\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282508 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-run-ovn\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282528 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-etc-selinux\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282554 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-run-multus-certs\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282697 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-sysctl-d\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282701 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-run-netns\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282707 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-system-cni-dir\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.282911 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-cnibin\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282787 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-cnibin\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282814 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-run\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e47f535-d51d-4a76-a64d-0fe4d83316fa-tmp-dir\") pod \"node-resolver-r6s2z\" (UID: \"2e47f535-d51d-4a76-a64d-0fe4d83316fa\") " pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282846 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-sysctl-conf\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-cni-dir\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.282853 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-os-release\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282912 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-hostroot\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282952 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-hostroot\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.282968 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs podName:86b8c493-d5fc-44f8-9aba-1a30e8f2a82b nodeName:}" failed. No retries permitted until 2026-07-27 17:00:21.782921335 +0000 UTC m=+3.031557825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs") pod "network-metrics-daemon-sv2m2" (UID: "86b8c493-d5fc-44f8-9aba-1a30e8f2a82b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282971 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-os-release\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.282986 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-cni-dir\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-sysconfig\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283034 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-var-lib-kubelet\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-tuned\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283091 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9347cd5-f0c6-452e-8506-9c8ccb162e67-tmp\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.283794 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283097 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-var-lib-kubelet\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283117 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-sysconfig\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283120 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ae0702f-a822-42b0-804b-074533de56f6-host-slash\") pod \"iptables-alerter-dbqn7\" (UID: \"4ae0702f-a822-42b0-804b-074533de56f6\") " pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-sys-fs\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0e3a68f-bcfd-4f6a-9663-a60146e7b64a-host\") pod \"node-ca-k9z9x\" (UID: \"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a\") " pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283190 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-modprobe-d\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283208 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-kubernetes\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-lib-modules\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283246 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e726e51d-787e-4b3f-b003-ad105dd69b3e-dbus\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283253 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0e3a68f-bcfd-4f6a-9663-a60146e7b64a-host\") pod \"node-ca-k9z9x\" (UID: \"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a\") " pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-device-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283280 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-sys-fs\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283297 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-conf-dir\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283306 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e726e51d-787e-4b3f-b003-ad105dd69b3e-dbus\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283342 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-conf-dir\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283343 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283351 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-kubernetes\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283362 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-device-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.284811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283349 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-modprobe-d\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283383 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-lib-modules\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-sys\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283447 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9cb9335e-07d6-4137-9f3a-51fb0413751f-konnectivity-ca\") pod \"konnectivity-agent-pk9f8\" (UID: \"9cb9335e-07d6-4137-9f3a-51fb0413751f\") " pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e726e51d-787e-4b3f-b003-ad105dd69b3e-kubelet-config\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.283485 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-var-lib-openvswitch\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283522 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-sys\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.283566 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret podName:e726e51d-787e-4b3f-b003-ad105dd69b3e nodeName:}" failed. No retries permitted until 2026-07-27 17:00:21.783550342 +0000 UTC m=+3.032186820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret") pod "global-pull-secret-syncer-m8xpw" (UID: "e726e51d-787e-4b3f-b003-ad105dd69b3e") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283562 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-var-lib-openvswitch\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283577 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e726e51d-787e-4b3f-b003-ad105dd69b3e-kubelet-config\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-run-openvswitch\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283642 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-run-openvswitch\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-run-k8s-cni-cncf-io\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-var-lib-cni-multus\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283715 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ae0702f-a822-42b0-804b-074533de56f6-iptables-alerter-script\") pod \"iptables-alerter-dbqn7\" (UID: \"4ae0702f-a822-42b0-804b-074533de56f6\") " pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.285814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f7zr\" (UniqueName: \"kubernetes.io/projected/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-kube-api-access-7f7zr\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283753 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-run-k8s-cni-cncf-io\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-ovnkube-script-lib\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283803 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-kubelet\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-node-log\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-socket-dir-parent\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283880 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e47f535-d51d-4a76-a64d-0fe4d83316fa-hosts-file\") pod \"node-resolver-r6s2z\" (UID: \"2e47f535-d51d-4a76-a64d-0fe4d83316fa\") " pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283908 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283933 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-socket-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283977 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-node-log\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-etc-openvswitch\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-var-lib-kubelet\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284024 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9gt2\" (UniqueName: \"kubernetes.io/projected/c32310eb-1b04-49f8-b512-e509d8f2d862-kube-api-access-c9gt2\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284028 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-etc-openvswitch\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-systemd\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284051 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9cb9335e-07d6-4137-9f3a-51fb0413751f-konnectivity-ca\") pod \"konnectivity-agent-pk9f8\" (UID: \"9cb9335e-07d6-4137-9f3a-51fb0413751f\") " pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284071 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdqnt\" (UniqueName: \"kubernetes.io/projected/b9347cd5-f0c6-452e-8506-9c8ccb162e67-kube-api-access-wdqnt\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.286559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-slash\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284094 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-multus-socket-dir-parent\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284106 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284121 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-var-lib-kubelet\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284133 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9cb9335e-07d6-4137-9f3a-51fb0413751f-agent-certs\") pod \"konnectivity-agent-pk9f8\" (UID: \"9cb9335e-07d6-4137-9f3a-51fb0413751f\") " pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284163 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-run-ovn-kubernetes\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284163 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fkg\" (UniqueName: \"kubernetes.io/projected/4ae0702f-a822-42b0-804b-074533de56f6-kube-api-access-n8fkg\") pod \"iptables-alerter-dbqn7\" (UID: \"4ae0702f-a822-42b0-804b-074533de56f6\") " pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284191 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-os-release\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-ovnkube-config\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.283780 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-var-lib-cni-multus\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284307 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-ovn-node-metrics-cert\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284339 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c32310eb-1b04-49f8-b512-e509d8f2d862-cni-binary-copy\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3155d2f3-4f29-4286-822a-c219199aa133-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-var-lib-cni-bin\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284437 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-etc-kubernetes\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284472 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3155d2f3-4f29-4286-822a-c219199aa133-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:21.287254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-log-socket\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-env-overrides\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxtqn\" (UniqueName: \"kubernetes.io/projected/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-kube-api-access-gxtqn\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmz8c\" (UniqueName: \"kubernetes.io/projected/c0e3a68f-bcfd-4f6a-9663-a60146e7b64a-kube-api-access-zmz8c\") pod \"node-ca-k9z9x\" (UID: \"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a\") " pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284903 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c32310eb-1b04-49f8-b512-e509d8f2d862-cni-binary-copy\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.284956 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-ovnkube-script-lib\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.285019 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-kubelet\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.285044 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-socket-dir\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.285244 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-ovnkube-config\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.285278 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-log-socket\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.285284 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-systemd\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.285303 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-host-slash\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.285651 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-host-var-lib-cni-bin\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.285701 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-env-overrides\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.286059 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c32310eb-1b04-49f8-b512-e509d8f2d862-etc-kubernetes\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.287882 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.287073 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b9347cd5-f0c6-452e-8506-9c8ccb162e67-tmp\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.288511 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.288016 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9cb9335e-07d6-4137-9f3a-51fb0413751f-agent-certs\") pod \"konnectivity-agent-pk9f8\" (UID: \"9cb9335e-07d6-4137-9f3a-51fb0413751f\") " pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:21.289309 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.289238 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-ovn-node-metrics-cert\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.290815 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.290783 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b9347cd5-f0c6-452e-8506-9c8ccb162e67-etc-tuned\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.295583 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.295557 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzph5\" (UniqueName: \"kubernetes.io/projected/3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6-kube-api-access-zzph5\") pod \"ovnkube-node-ccmz8\" (UID: \"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6\") " pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.296383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.296358 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxtqn\" (UniqueName: \"kubernetes.io/projected/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-kube-api-access-gxtqn\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:21.296946 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.296913 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmz8c\" (UniqueName: \"kubernetes.io/projected/c0e3a68f-bcfd-4f6a-9663-a60146e7b64a-kube-api-access-zmz8c\") pod \"node-ca-k9z9x\" (UID: \"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a\") " pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.297047 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.296912 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9gt2\" (UniqueName: \"kubernetes.io/projected/c32310eb-1b04-49f8-b512-e509d8f2d862-kube-api-access-c9gt2\") pod \"multus-zpjxn\" (UID: \"c32310eb-1b04-49f8-b512-e509d8f2d862\") " pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.298193 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.298169 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdqnt\" (UniqueName: \"kubernetes.io/projected/b9347cd5-f0c6-452e-8506-9c8ccb162e67-kube-api-access-wdqnt\") pod \"tuned-hsfg8\" (UID: \"b9347cd5-f0c6-452e-8506-9c8ccb162e67\") " pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.298445 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.298423 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f7zr\" (UniqueName: \"kubernetes.io/projected/ad0c1376-21c9-492b-9c58-d2ed86fb0fb5-kube-api-access-7f7zr\") pod \"aws-ebs-csi-driver-node-j8qsv\" (UID: \"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.385236 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385199 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3155d2f3-4f29-4286-822a-c219199aa133-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.385362 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:21.385362 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385273 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-system-cni-dir\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.385362 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385297 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-cnibin\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.385362 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385322 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3155d2f3-4f29-4286-822a-c219199aa133-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.385636 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qwzz\" (UniqueName: \"kubernetes.io/projected/2e47f535-d51d-4a76-a64d-0fe4d83316fa-kube-api-access-6qwzz\") pod \"node-resolver-r6s2z\" (UID: \"2e47f535-d51d-4a76-a64d-0fe4d83316fa\") " pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.385636 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385386 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns87l\" (UniqueName: \"kubernetes.io/projected/3155d2f3-4f29-4286-822a-c219199aa133-kube-api-access-ns87l\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.385636 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385399 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-system-cni-dir\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.385636 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385428 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e47f535-d51d-4a76-a64d-0fe4d83316fa-tmp-dir\") pod \"node-resolver-r6s2z\" (UID: \"2e47f535-d51d-4a76-a64d-0fe4d83316fa\") " pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.385636 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ae0702f-a822-42b0-804b-074533de56f6-host-slash\") pod \"iptables-alerter-dbqn7\" (UID: \"4ae0702f-a822-42b0-804b-074533de56f6\") " pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.385636 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ae0702f-a822-42b0-804b-074533de56f6-iptables-alerter-script\") pod \"iptables-alerter-dbqn7\" (UID: \"4ae0702f-a822-42b0-804b-074533de56f6\") " pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.385636 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385549 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-cnibin\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.385636 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e47f535-d51d-4a76-a64d-0fe4d83316fa-hosts-file\") pod \"node-resolver-r6s2z\" (UID: \"2e47f535-d51d-4a76-a64d-0fe4d83316fa\") " pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.385636 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.386144 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385657 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e47f535-d51d-4a76-a64d-0fe4d83316fa-hosts-file\") pod \"node-resolver-r6s2z\" (UID: \"2e47f535-d51d-4a76-a64d-0fe4d83316fa\") " pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.386144 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385902 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3155d2f3-4f29-4286-822a-c219199aa133-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.386144 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385938 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3155d2f3-4f29-4286-822a-c219199aa133-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.386144 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.385966 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e47f535-d51d-4a76-a64d-0fe4d83316fa-tmp-dir\") pod \"node-resolver-r6s2z\" (UID: \"2e47f535-d51d-4a76-a64d-0fe4d83316fa\") " pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.386144 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.386033 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ae0702f-a822-42b0-804b-074533de56f6-host-slash\") pod \"iptables-alerter-dbqn7\" (UID: \"4ae0702f-a822-42b0-804b-074533de56f6\") " pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.386387 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.386167 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.386387 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.386181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fkg\" (UniqueName: \"kubernetes.io/projected/4ae0702f-a822-42b0-804b-074533de56f6-kube-api-access-n8fkg\") pod \"iptables-alerter-dbqn7\" (UID: \"4ae0702f-a822-42b0-804b-074533de56f6\") " pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.386387 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.386214 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-os-release\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.386387 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.386244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3155d2f3-4f29-4286-822a-c219199aa133-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.386635 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.386397 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ae0702f-a822-42b0-804b-074533de56f6-iptables-alerter-script\") pod \"iptables-alerter-dbqn7\" (UID: \"4ae0702f-a822-42b0-804b-074533de56f6\") " pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.386635 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.386570 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3155d2f3-4f29-4286-822a-c219199aa133-os-release\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.386757 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.386736 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3155d2f3-4f29-4286-822a-c219199aa133-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.394011 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.393988 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:00:21.394313 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.394015 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:00:21.394313 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.394030 2558 projected.go:196] Error preparing data for projected volume kube-api-access-lbdcb for pod openshift-network-diagnostics/network-check-target-fzxxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:21.394313 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.394092 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb podName:0cf5db6e-8a9f-4bed-bca3-873abc56cf26 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:21.894072093 +0000 UTC m=+3.142708584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lbdcb" (UniqueName: "kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb") pod "network-check-target-fzxxj" (UID: "0cf5db6e-8a9f-4bed-bca3-873abc56cf26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:21.396664 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.396645 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fkg\" (UniqueName: \"kubernetes.io/projected/4ae0702f-a822-42b0-804b-074533de56f6-kube-api-access-n8fkg\") pod \"iptables-alerter-dbqn7\" (UID: \"4ae0702f-a822-42b0-804b-074533de56f6\") " pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.396761 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.396650 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns87l\" (UniqueName: \"kubernetes.io/projected/3155d2f3-4f29-4286-822a-c219199aa133-kube-api-access-ns87l\") pod \"multus-additional-cni-plugins-4cg26\" (UID: \"3155d2f3-4f29-4286-822a-c219199aa133\") " pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.396761 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.396743 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qwzz\" (UniqueName: \"kubernetes.io/projected/2e47f535-d51d-4a76-a64d-0fe4d83316fa-kube-api-access-6qwzz\") pod \"node-resolver-r6s2z\" (UID: \"2e47f535-d51d-4a76-a64d-0fe4d83316fa\") " pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.465131 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.465106 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" Jul 27 17:00:21.477629 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.477607 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:21.488650 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.488631 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k9z9x" Jul 27 17:00:21.495732 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.495711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" Jul 27 17:00:21.505764 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.505745 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zpjxn" Jul 27 17:00:21.512673 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.512654 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:21.521440 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.521422 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dbqn7" Jul 27 17:00:21.529272 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.529254 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r6s2z" Jul 27 17:00:21.535973 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.535958 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4cg26" Jul 27 17:00:21.788459 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.788383 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:21.788459 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.788422 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:21.788712 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.788554 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:21.788712 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.788592 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:21.788712 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.788631 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret podName:e726e51d-787e-4b3f-b003-ad105dd69b3e nodeName:}" failed. No retries permitted until 2026-07-27 17:00:22.788606871 +0000 UTC m=+4.037243339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret") pod "global-pull-secret-syncer-m8xpw" (UID: "e726e51d-787e-4b3f-b003-ad105dd69b3e") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:21.788712 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.788658 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs podName:86b8c493-d5fc-44f8-9aba-1a30e8f2a82b nodeName:}" failed. No retries permitted until 2026-07-27 17:00:22.788643156 +0000 UTC m=+4.037279622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs") pod "network-metrics-daemon-sv2m2" (UID: "86b8c493-d5fc-44f8-9aba-1a30e8f2a82b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:21.989565 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:21.989531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:21.989714 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.989698 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:00:21.989756 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.989718 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:00:21.989756 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.989728 2558 projected.go:196] Error preparing data for projected volume kube-api-access-lbdcb for pod openshift-network-diagnostics/network-check-target-fzxxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:21.989825 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:21.989780 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb podName:0cf5db6e-8a9f-4bed-bca3-873abc56cf26 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:22.989764882 +0000 UTC m=+4.238401348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbdcb" (UniqueName: "kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb") pod "network-check-target-fzxxj" (UID: "0cf5db6e-8a9f-4bed-bca3-873abc56cf26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:22.213269 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:22.213179 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:55:21 +0000 UTC" deadline="2028-04-24 08:12:27.512349514 +0000 UTC" Jul 27 17:00:22.213269 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:22.213214 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15279h12m5.29913997s" Jul 27 17:00:22.242717 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:22.242681 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:22.242856 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:22.242786 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:22.369537 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:22.369487 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3155d2f3_4f29_4286_822a_c219199aa133.slice/crio-807bdf9e09a1826e90de90a4d7f3fdfab16f5b7e0ed43f453ad6dde1b9caa4d3 WatchSource:0}: Error finding container 807bdf9e09a1826e90de90a4d7f3fdfab16f5b7e0ed43f453ad6dde1b9caa4d3: Status 404 returned error can't find the container with id 807bdf9e09a1826e90de90a4d7f3fdfab16f5b7e0ed43f453ad6dde1b9caa4d3 Jul 27 17:00:22.376401 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:22.376371 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e47f535_d51d_4a76_a64d_0fe4d83316fa.slice/crio-94221b18a3a3b8b7ec1eec958a516e810c8ae1514cf993909dfdd70324e4e7ad WatchSource:0}: Error finding container 94221b18a3a3b8b7ec1eec958a516e810c8ae1514cf993909dfdd70324e4e7ad: Status 404 returned error can't find the container with id 94221b18a3a3b8b7ec1eec958a516e810c8ae1514cf993909dfdd70324e4e7ad Jul 27 17:00:22.378085 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:22.378056 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb9335e_07d6_4137_9f3a_51fb0413751f.slice/crio-9081408bf8e786236f5c02c4e5911a488d33c3285219f2eaf0b175c5c9e82b0e WatchSource:0}: Error finding container 9081408bf8e786236f5c02c4e5911a488d33c3285219f2eaf0b175c5c9e82b0e: Status 404 returned error can't find the container with id 9081408bf8e786236f5c02c4e5911a488d33c3285219f2eaf0b175c5c9e82b0e Jul 27 17:00:22.378899 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:22.378872 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa51bf0_cb15_4a82_99a7_d6b95ee9c6a6.slice/crio-98f2a9850d92d5081f72bcd1e7aa08aacc375c0588724bfd0a3438da1caf14c8 WatchSource:0}: Error finding container 98f2a9850d92d5081f72bcd1e7aa08aacc375c0588724bfd0a3438da1caf14c8: Status 404 returned error can't find the container with id 98f2a9850d92d5081f72bcd1e7aa08aacc375c0588724bfd0a3438da1caf14c8 Jul 27 17:00:22.380854 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:22.380465 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae0702f_a822_42b0_804b_074533de56f6.slice/crio-6e77f5a0b63e9f035629da21dd2f05e007a6958ab1cea7e439bc7362bae35fb8 WatchSource:0}: Error finding container 6e77f5a0b63e9f035629da21dd2f05e007a6958ab1cea7e439bc7362bae35fb8: Status 404 returned error can't find the container with id 6e77f5a0b63e9f035629da21dd2f05e007a6958ab1cea7e439bc7362bae35fb8 Jul 27 17:00:22.382801 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:22.382776 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32310eb_1b04_49f8_b512_e509d8f2d862.slice/crio-3f901075e38d21118a46b635da348c8802e5d061f808de9d646f2de8e6da9968 WatchSource:0}: Error finding container 3f901075e38d21118a46b635da348c8802e5d061f808de9d646f2de8e6da9968: Status 404 returned error can't find the container with id 3f901075e38d21118a46b635da348c8802e5d061f808de9d646f2de8e6da9968 Jul 27 17:00:22.407710 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:22.407689 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0c1376_21c9_492b_9c58_d2ed86fb0fb5.slice/crio-f70ce11237ecb1a143611825b1343bfbb23253d3cafb5125f75147596bb865a0 WatchSource:0}: Error finding container f70ce11237ecb1a143611825b1343bfbb23253d3cafb5125f75147596bb865a0: Status 404 returned error can't find the container with id f70ce11237ecb1a143611825b1343bfbb23253d3cafb5125f75147596bb865a0 Jul 27 17:00:22.409408 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:22.409380 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e3a68f_bcfd_4f6a_9663_a60146e7b64a.slice/crio-c15507909fbf4beac6a641360de8b1c57aff1d2cbd5d2c9470431f45f03244ba WatchSource:0}: Error finding container c15507909fbf4beac6a641360de8b1c57aff1d2cbd5d2c9470431f45f03244ba: Status 404 returned error can't find the container with id c15507909fbf4beac6a641360de8b1c57aff1d2cbd5d2c9470431f45f03244ba Jul 27 17:00:22.410395 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:22.410374 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9347cd5_f0c6_452e_8506_9c8ccb162e67.slice/crio-2b7066434319425356f59f48160b600e9405cafcb31b585a6b31577b9c68d5a7 WatchSource:0}: Error finding container 2b7066434319425356f59f48160b600e9405cafcb31b585a6b31577b9c68d5a7: Status 404 returned error can't find the container with id 2b7066434319425356f59f48160b600e9405cafcb31b585a6b31577b9c68d5a7 Jul 27 17:00:22.796275 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:22.796066 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:22.796275 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:22.796261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:22.796399 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:22.796182 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:22.796399 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:22.796372 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs podName:86b8c493-d5fc-44f8-9aba-1a30e8f2a82b nodeName:}" failed. No retries permitted until 2026-07-27 17:00:24.796352365 +0000 UTC m=+6.044988835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs") pod "network-metrics-daemon-sv2m2" (UID: "86b8c493-d5fc-44f8-9aba-1a30e8f2a82b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:22.796399 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:22.796385 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:22.796511 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:22.796424 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret podName:e726e51d-787e-4b3f-b003-ad105dd69b3e nodeName:}" failed. No retries permitted until 2026-07-27 17:00:24.796413391 +0000 UTC m=+6.045049858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret") pod "global-pull-secret-syncer-m8xpw" (UID: "e726e51d-787e-4b3f-b003-ad105dd69b3e") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:22.998010 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:22.997978 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:22.998222 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:22.998203 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:00:22.998287 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:22.998236 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:00:22.998287 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:22.998251 2558 projected.go:196] Error preparing data for projected volume kube-api-access-lbdcb for pod openshift-network-diagnostics/network-check-target-fzxxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:22.998365 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:22.998308 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb podName:0cf5db6e-8a9f-4bed-bca3-873abc56cf26 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:24.998287871 +0000 UTC m=+6.246924339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbdcb" (UniqueName: "kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb") pod "network-check-target-fzxxj" (UID: "0cf5db6e-8a9f-4bed-bca3-873abc56cf26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:23.214029 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.213933 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 16:55:21 +0000 UTC" deadline="2028-04-19 10:35:46.044276836 +0000 UTC" Jul 27 17:00:23.214029 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.213973 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15161h35m22.830309113s" Jul 27 17:00:23.250062 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.248736 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:23.250062 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.248742 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:23.250062 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:23.248899 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:23.250062 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:23.249048 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:23.258200 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.258170 2558 generic.go:356] "Generic (PLEG): container finished" podID="057e9c75ccfc3d58f1d145dcbffdeca7" containerID="9abb5b0502370ca93aac443ca118662dd81bdf5608902031d5c8dad6fa5d90d5" exitCode=0 Jul 27 17:00:23.258425 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.258365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" event={"ID":"057e9c75ccfc3d58f1d145dcbffdeca7","Type":"ContainerDied","Data":"9abb5b0502370ca93aac443ca118662dd81bdf5608902031d5c8dad6fa5d90d5"} Jul 27 17:00:23.260905 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.260848 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal" event={"ID":"2765500e3b6ee453220e06c841f29167","Type":"ContainerStarted","Data":"67a3c7e3f60f2572bf815b7b215892af16d70e5a90451896c45899f7b5c2128f"} Jul 27 17:00:23.265534 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.265490 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" event={"ID":"b9347cd5-f0c6-452e-8506-9c8ccb162e67","Type":"ContainerStarted","Data":"2b7066434319425356f59f48160b600e9405cafcb31b585a6b31577b9c68d5a7"} Jul 27 17:00:23.268027 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.267999 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zpjxn" event={"ID":"c32310eb-1b04-49f8-b512-e509d8f2d862","Type":"ContainerStarted","Data":"3f901075e38d21118a46b635da348c8802e5d061f808de9d646f2de8e6da9968"} Jul 27 17:00:23.271922 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.271877 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" event={"ID":"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6","Type":"ContainerStarted","Data":"98f2a9850d92d5081f72bcd1e7aa08aacc375c0588724bfd0a3438da1caf14c8"} Jul 27 17:00:23.275559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.275529 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pk9f8" event={"ID":"9cb9335e-07d6-4137-9f3a-51fb0413751f","Type":"ContainerStarted","Data":"9081408bf8e786236f5c02c4e5911a488d33c3285219f2eaf0b175c5c9e82b0e"} Jul 27 17:00:23.278418 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.278396 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r6s2z" event={"ID":"2e47f535-d51d-4a76-a64d-0fe4d83316fa","Type":"ContainerStarted","Data":"94221b18a3a3b8b7ec1eec958a516e810c8ae1514cf993909dfdd70324e4e7ad"} Jul 27 17:00:23.280616 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.280583 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cg26" event={"ID":"3155d2f3-4f29-4286-822a-c219199aa133","Type":"ContainerStarted","Data":"807bdf9e09a1826e90de90a4d7f3fdfab16f5b7e0ed43f453ad6dde1b9caa4d3"} Jul 27 17:00:23.285281 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.285256 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k9z9x" event={"ID":"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a","Type":"ContainerStarted","Data":"c15507909fbf4beac6a641360de8b1c57aff1d2cbd5d2c9470431f45f03244ba"} Jul 27 17:00:23.287042 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.287019 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" event={"ID":"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5","Type":"ContainerStarted","Data":"f70ce11237ecb1a143611825b1343bfbb23253d3cafb5125f75147596bb865a0"} Jul 27 17:00:23.288707 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:23.288682 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dbqn7" event={"ID":"4ae0702f-a822-42b0-804b-074533de56f6","Type":"ContainerStarted","Data":"6e77f5a0b63e9f035629da21dd2f05e007a6958ab1cea7e439bc7362bae35fb8"} Jul 27 17:00:24.242947 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:24.242916 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:24.243422 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:24.243069 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:24.315419 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:24.315380 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" event={"ID":"057e9c75ccfc3d58f1d145dcbffdeca7","Type":"ContainerStarted","Data":"398da3fe5712d6814bb882bf84c2fe3527a82b9fc79b176e7040ddd8a0e3c7f9"} Jul 27 17:00:24.334002 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:24.333939 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-73.ec2.internal" podStartSLOduration=4.33391855 podStartE2EDuration="4.33391855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:23.303987139 +0000 UTC m=+4.552623655" watchObservedRunningTime="2026-07-27 17:00:24.33391855 +0000 UTC m=+5.582555043" Jul 27 17:00:24.813382 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:24.812788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:24.813382 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:24.812861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:24.813382 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:24.813048 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:24.813382 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:24.813118 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret podName:e726e51d-787e-4b3f-b003-ad105dd69b3e nodeName:}" failed. No retries permitted until 2026-07-27 17:00:28.813097733 +0000 UTC m=+10.061734219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret") pod "global-pull-secret-syncer-m8xpw" (UID: "e726e51d-787e-4b3f-b003-ad105dd69b3e") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:24.813783 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:24.813532 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:24.813783 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:24.813608 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs podName:86b8c493-d5fc-44f8-9aba-1a30e8f2a82b nodeName:}" failed. No retries permitted until 2026-07-27 17:00:28.813572502 +0000 UTC m=+10.062208972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs") pod "network-metrics-daemon-sv2m2" (UID: "86b8c493-d5fc-44f8-9aba-1a30e8f2a82b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:25.015193 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:25.015159 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:25.015392 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:25.015374 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:00:25.015455 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:25.015403 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:00:25.015455 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:25.015417 2558 projected.go:196] Error preparing data for projected volume kube-api-access-lbdcb for pod openshift-network-diagnostics/network-check-target-fzxxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:25.015575 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:25.015500 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb podName:0cf5db6e-8a9f-4bed-bca3-873abc56cf26 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:29.015478467 +0000 UTC m=+10.264114936 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbdcb" (UniqueName: "kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb") pod "network-check-target-fzxxj" (UID: "0cf5db6e-8a9f-4bed-bca3-873abc56cf26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:25.244797 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:25.244713 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:25.245266 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:25.244866 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:25.245266 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:25.244904 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:25.245266 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:25.245023 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:26.242507 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:26.242472 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:26.242712 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:26.242645 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:27.242737 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:27.242693 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:27.243216 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:27.242829 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:27.243347 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:27.243315 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:27.243500 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:27.243439 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:28.242468 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:28.242381 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:28.242650 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:28.242526 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:28.846118 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:28.846087 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:28.846575 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:28.846131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:28.846575 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:28.846236 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:28.846575 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:28.846236 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:28.846575 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:28.846290 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret podName:e726e51d-787e-4b3f-b003-ad105dd69b3e nodeName:}" failed. No retries permitted until 2026-07-27 17:00:36.846273013 +0000 UTC m=+18.094909493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret") pod "global-pull-secret-syncer-m8xpw" (UID: "e726e51d-787e-4b3f-b003-ad105dd69b3e") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:28.846575 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:28.846307 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs podName:86b8c493-d5fc-44f8-9aba-1a30e8f2a82b nodeName:}" failed. No retries permitted until 2026-07-27 17:00:36.846298409 +0000 UTC m=+18.094934877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs") pod "network-metrics-daemon-sv2m2" (UID: "86b8c493-d5fc-44f8-9aba-1a30e8f2a82b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:29.047113 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:29.047077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:29.047254 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:29.047191 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:00:29.047254 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:29.047208 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:00:29.047254 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:29.047219 2558 projected.go:196] Error preparing data for projected volume kube-api-access-lbdcb for pod openshift-network-diagnostics/network-check-target-fzxxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:29.047359 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:29.047273 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb podName:0cf5db6e-8a9f-4bed-bca3-873abc56cf26 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:37.047255729 +0000 UTC m=+18.295892219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbdcb" (UniqueName: "kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb") pod "network-check-target-fzxxj" (UID: "0cf5db6e-8a9f-4bed-bca3-873abc56cf26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:29.242996 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:29.242771 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:29.242996 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:29.242874 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:29.243411 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:29.243247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:29.243411 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:29.243344 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:30.242280 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:30.242249 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:30.242667 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:30.242385 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:31.242279 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:31.242204 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:31.242449 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:31.242328 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:31.242826 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:31.242609 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:31.242826 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:31.242703 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:32.242684 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:32.242493 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:32.242684 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:32.242647 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:33.241897 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:33.241863 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:33.241897 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:33.241881 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:33.242128 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:33.241965 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:33.242128 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:33.242020 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:34.242552 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:34.242516 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:34.242987 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:34.242635 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:35.242143 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:35.242110 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:35.242293 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:35.242277 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:35.242331 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:35.242307 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:35.242394 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:35.242378 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:36.241905 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:36.241876 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:36.242334 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:36.242003 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:36.909520 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:36.909473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:36.909764 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:36.909544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:36.909764 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:36.909606 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:36.909764 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:36.909649 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:36.909764 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:36.909677 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs podName:86b8c493-d5fc-44f8-9aba-1a30e8f2a82b nodeName:}" failed. No retries permitted until 2026-07-27 17:00:52.909654711 +0000 UTC m=+34.158291199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs") pod "network-metrics-daemon-sv2m2" (UID: "86b8c493-d5fc-44f8-9aba-1a30e8f2a82b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:36.909764 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:36.909700 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret podName:e726e51d-787e-4b3f-b003-ad105dd69b3e nodeName:}" failed. No retries permitted until 2026-07-27 17:00:52.909689865 +0000 UTC m=+34.158326331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret") pod "global-pull-secret-syncer-m8xpw" (UID: "e726e51d-787e-4b3f-b003-ad105dd69b3e") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:37.110535 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:37.110490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:37.110698 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:37.110618 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:00:37.110698 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:37.110644 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:00:37.110698 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:37.110655 2558 projected.go:196] Error preparing data for projected volume kube-api-access-lbdcb for pod openshift-network-diagnostics/network-check-target-fzxxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:37.110844 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:37.110714 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb podName:0cf5db6e-8a9f-4bed-bca3-873abc56cf26 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:53.110700207 +0000 UTC m=+34.359336675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbdcb" (UniqueName: "kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb") pod "network-check-target-fzxxj" (UID: "0cf5db6e-8a9f-4bed-bca3-873abc56cf26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:37.241739 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:37.241665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:37.241889 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:37.241665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:37.241889 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:37.241777 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:37.241889 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:37.241874 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:38.242096 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:38.242047 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:38.242521 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:38.242188 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:39.242436 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:39.242407 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:39.242879 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:39.242521 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:39.242879 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:39.242528 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:39.242879 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:39.242617 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:40.241886 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:40.241850 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:40.242067 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:40.241972 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:41.242401 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.242068 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:41.242401 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:41.242368 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:41.242863 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.242444 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:41.242863 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:41.242536 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:41.359818 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.359617 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r6s2z" event={"ID":"2e47f535-d51d-4a76-a64d-0fe4d83316fa","Type":"ContainerStarted","Data":"dad1fcc8e44e13b5be8263b7aa2c38a7349a9fa83a93a485ca45440fd1120adb"} Jul 27 17:00:41.363976 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.363948 2558 generic.go:356] "Generic (PLEG): container finished" podID="3155d2f3-4f29-4286-822a-c219199aa133" containerID="2faf44d4d7a38600808534603b3fa298db61a94dd970cff5b01c0c640f9ed21a" exitCode=0 Jul 27 17:00:41.364198 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.364181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cg26" event={"ID":"3155d2f3-4f29-4286-822a-c219199aa133","Type":"ContainerDied","Data":"2faf44d4d7a38600808534603b3fa298db61a94dd970cff5b01c0c640f9ed21a"} Jul 27 17:00:41.367117 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.367069 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k9z9x" event={"ID":"c0e3a68f-bcfd-4f6a-9663-a60146e7b64a","Type":"ContainerStarted","Data":"84a6379e02059262fb20399bb1814efe32534624498268a55edab3394ffb5eba"} Jul 27 17:00:41.369332 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.369310 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" event={"ID":"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5","Type":"ContainerStarted","Data":"6f59f5c1b8cddfc4b3ff6960ca5b4accc7d65f0b45e973b5dd647ee243583d44"} Jul 27 17:00:41.370972 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.370919 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" event={"ID":"b9347cd5-f0c6-452e-8506-9c8ccb162e67","Type":"ContainerStarted","Data":"efd0fc608470a978f971363e032875ce080c8aa9a6b67194335d82249c72c396"} Jul 27 17:00:41.372540 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.372516 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zpjxn" event={"ID":"c32310eb-1b04-49f8-b512-e509d8f2d862","Type":"ContainerStarted","Data":"1d3287577ad3a7d970ea21006fff40712b9e9719d5d621604a3bd08181d46f5e"} Jul 27 17:00:41.374043 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.374021 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" event={"ID":"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6","Type":"ContainerStarted","Data":"6766d93497125d014fa0a3feb976cbad22d5a84dcae8c72b4540b652c588c5c3"} Jul 27 17:00:41.376534 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.375763 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pk9f8" event={"ID":"9cb9335e-07d6-4137-9f3a-51fb0413751f","Type":"ContainerStarted","Data":"53cc55e272866d63fb81cde5b1aa14457276363adcdd75d94be88276e4a615b2"} Jul 27 17:00:41.377071 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.377038 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-73.ec2.internal" podStartSLOduration=21.377011787 podStartE2EDuration="21.377011787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:24.334341001 +0000 UTC m=+5.582977495" watchObservedRunningTime="2026-07-27 17:00:41.377011787 +0000 UTC m=+22.625648268" Jul 27 17:00:41.392038 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.391912 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r6s2z" podStartSLOduration=2.667231258 podStartE2EDuration="21.391900563s" totalImagesPullingTime="18.724669305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:41.377685573 +0000 UTC m=+22.626322059" watchObservedRunningTime="2026-07-27 17:00:41.391900563 +0000 UTC m=+22.640537050" Jul 27 17:00:41.392557 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.392532 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k9z9x" podStartSLOduration=3.704147622 podStartE2EDuration="22.392524723s" totalImagesPullingTime="18.688377101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:41.391752123 +0000 UTC m=+22.640388611" watchObservedRunningTime="2026-07-27 17:00:41.392524723 +0000 UTC m=+22.641161200" Jul 27 17:00:41.411334 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.411299 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zpjxn" podStartSLOduration=2.649843552 podStartE2EDuration="21.411285144s" totalImagesPullingTime="18.761441592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:41.410681103 +0000 UTC m=+22.659317591" watchObservedRunningTime="2026-07-27 17:00:41.411285144 +0000 UTC m=+22.659921633" Jul 27 17:00:41.429122 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.429089 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hsfg8" podStartSLOduration=2.737081516 podStartE2EDuration="21.429080377s" totalImagesPullingTime="18.691998861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:41.428855172 +0000 UTC m=+22.677491660" watchObservedRunningTime="2026-07-27 17:00:41.429080377 +0000 UTC m=+22.677716867" Jul 27 17:00:41.446467 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:41.446432 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pk9f8" podStartSLOduration=2.726955826 podStartE2EDuration="21.446418566s" totalImagesPullingTime="18.71946274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:41.446418306 +0000 UTC m=+22.695054840" watchObservedRunningTime="2026-07-27 17:00:41.446418566 +0000 UTC m=+22.695055052" Jul 27 17:00:42.241696 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.241666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:42.241845 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:42.241801 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:42.247034 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.247013 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:42.247858 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.247837 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:42.386523 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.386425 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" event={"ID":"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6","Type":"ContainerStarted","Data":"35664a7bacd509cbe26417d4d101f7ec11068a731d7b909bb03ea7d3d207563c"} Jul 27 17:00:42.386697 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.386570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" event={"ID":"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6","Type":"ContainerStarted","Data":"23c5250dd1b2979b4b484bb1fd1cc0cff5d118b1526f02fb5a1ad90e82e8a6ca"} Jul 27 17:00:42.386697 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.386624 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" event={"ID":"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6","Type":"ContainerStarted","Data":"89f3c8b43455c9a6cd4e4f49eab1ba1367765c925761e04182b8b97cba5cacc4"} Jul 27 17:00:42.386697 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.386657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" event={"ID":"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6","Type":"ContainerStarted","Data":"481c37bd6208f5959cc3ec4d4654bc60cf0cda84139af98941f5ce6d92607802"} Jul 27 17:00:42.386697 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.386695 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" event={"ID":"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6","Type":"ContainerStarted","Data":"67de01c467e3812347362cc990ebf753df9936d7ac82beefbc904d6122ab113e"} Jul 27 17:00:42.388619 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.388590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dbqn7" event={"ID":"4ae0702f-a822-42b0-804b-074533de56f6","Type":"ContainerStarted","Data":"4d711d98fbab34230fb6b13574fc5ac4c2041e388ffc884cf4e003cbbb349f3a"} Jul 27 17:00:42.390011 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.389956 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:42.390643 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.390623 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:00:42.406332 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.406272 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dbqn7" podStartSLOduration=3.684865346 podStartE2EDuration="22.406260398s" totalImagesPullingTime="18.721395052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:42.406006365 +0000 UTC m=+23.654642853" watchObservedRunningTime="2026-07-27 17:00:42.406260398 +0000 UTC m=+23.654896898" Jul 27 17:00:42.791433 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:42.791411 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 27 17:00:43.239912 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:43.239816 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T17:00:42.791429611Z","UUID":"45ac7de8-d6f8-46a5-87f5-265251effa2d","Handler":null,"Name":"","Endpoint":""} Jul 27 17:00:43.241549 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:43.241528 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 27 17:00:43.241682 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:43.241575 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 27 17:00:43.241741 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:43.241709 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:43.241886 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:43.241810 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:43.241886 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:43.241868 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:43.242073 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:43.241970 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:43.393041 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:43.393011 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" event={"ID":"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5","Type":"ContainerStarted","Data":"8093715ac0aa7d93d78c2bf2fa392ac95b37616e71989d1e550b1da9e729dd42"} Jul 27 17:00:44.242497 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:44.242421 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:44.242733 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:44.242570 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:44.398749 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:44.398713 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" event={"ID":"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6","Type":"ContainerStarted","Data":"7374dc91c427410c5082334d7a558b2f2f1550d3eeb4ced908518b6a22dd28f7"} Jul 27 17:00:45.242692 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:45.242459 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:45.242954 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:45.242527 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:45.242954 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:45.242783 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:45.242954 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:45.242877 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:46.242236 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.242180 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:46.242784 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:46.242302 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:46.405740 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.405552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" event={"ID":"3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6","Type":"ContainerStarted","Data":"83e6bbd8c323effacc0a8bc954c052a92645f0f47aca0328d51763da3adafa91"} Jul 27 17:00:46.405884 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.405797 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:46.405884 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.405849 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:46.405988 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.405893 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:46.407660 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.407638 2558 generic.go:356] "Generic (PLEG): container finished" podID="3155d2f3-4f29-4286-822a-c219199aa133" containerID="c6d0f0747c25d3f46ca7f69d5b21058b84e6ce482d3fa1274a994633b6b2189a" exitCode=0 Jul 27 17:00:46.407789 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.407705 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cg26" event={"ID":"3155d2f3-4f29-4286-822a-c219199aa133","Type":"ContainerDied","Data":"c6d0f0747c25d3f46ca7f69d5b21058b84e6ce482d3fa1274a994633b6b2189a"} Jul 27 17:00:46.410425 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.410399 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" event={"ID":"ad0c1376-21c9-492b-9c58-d2ed86fb0fb5","Type":"ContainerStarted","Data":"7ccbdaad8d4bfcfc482fda827e9d9c3a09779498664f40407cd87ad2ecef8930"} Jul 27 17:00:46.422113 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.422096 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:46.422200 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.422190 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:00:46.436989 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.436955 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" podStartSLOduration=8.649793504 podStartE2EDuration="27.436944385s" totalImagesPullingTime="18.787150881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:46.436697117 +0000 UTC m=+27.685333598" watchObservedRunningTime="2026-07-27 17:00:46.436944385 +0000 UTC m=+27.685580875" Jul 27 17:00:46.487422 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:46.487381 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j8qsv" podStartSLOduration=4.253653665 podStartE2EDuration="27.487369652s" totalImagesPullingTime="23.233715987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:46.45799408 +0000 UTC m=+27.706630567" watchObservedRunningTime="2026-07-27 17:00:46.487369652 +0000 UTC m=+27.736006139" Jul 27 17:00:47.242843 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:47.242756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:47.243296 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:47.242880 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:47.243296 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:47.242918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:47.243296 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:47.242997 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:48.242061 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:48.241978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:48.242250 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:48.242114 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:48.333110 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:48.333081 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m8xpw"] Jul 27 17:00:48.333529 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:48.333177 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:48.333529 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:48.333286 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:48.336295 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:48.336268 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fzxxj"] Jul 27 17:00:48.336404 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:48.336348 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:48.336468 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:48.336421 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:48.338867 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:48.338845 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sv2m2"] Jul 27 17:00:48.418757 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:48.418730 2558 generic.go:356] "Generic (PLEG): container finished" podID="3155d2f3-4f29-4286-822a-c219199aa133" containerID="07b5dd35bf408a07dbed5ceb4d4ccde57960daf102088b9bd173facf7bdca5b3" exitCode=0 Jul 27 17:00:48.418844 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:48.418807 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cg26" event={"ID":"3155d2f3-4f29-4286-822a-c219199aa133","Type":"ContainerDied","Data":"07b5dd35bf408a07dbed5ceb4d4ccde57960daf102088b9bd173facf7bdca5b3"} Jul 27 17:00:48.419216 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:48.419197 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:48.419356 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:48.419324 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:50.241818 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:50.241789 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:50.242159 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:50.241889 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:50.242159 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:50.241894 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:50.242159 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:50.241947 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:50.242159 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:50.241891 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:50.242159 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:50.242051 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:52.242226 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:52.242039 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:52.242583 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:52.242045 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:52.242583 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:52.242314 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv2m2" podUID="86b8c493-d5fc-44f8-9aba-1a30e8f2a82b" Jul 27 17:00:52.242583 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:52.242045 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:52.242583 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:52.242395 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m8xpw" podUID="e726e51d-787e-4b3f-b003-ad105dd69b3e" Jul 27 17:00:52.242583 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:52.242478 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fzxxj" podUID="0cf5db6e-8a9f-4bed-bca3-873abc56cf26" Jul 27 17:00:52.428572 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:52.428541 2558 generic.go:356] "Generic (PLEG): container finished" podID="3155d2f3-4f29-4286-822a-c219199aa133" containerID="c1e308c101a19efbcb15181ab3b1b8c6c84020aa5260f7569d6a9cfe9ca67e33" exitCode=0 Jul 27 17:00:52.428710 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:52.428582 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cg26" event={"ID":"3155d2f3-4f29-4286-822a-c219199aa133","Type":"ContainerDied","Data":"c1e308c101a19efbcb15181ab3b1b8c6c84020aa5260f7569d6a9cfe9ca67e33"} Jul 27 17:00:52.929896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:52.929865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:52.930071 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:52.929925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:52.930071 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:52.930009 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:52.930071 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:52.930031 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:52.930071 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:52.930069 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs podName:86b8c493-d5fc-44f8-9aba-1a30e8f2a82b nodeName:}" failed. No retries permitted until 2026-07-27 17:01:24.930055003 +0000 UTC m=+66.178691468 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs") pod "network-metrics-daemon-sv2m2" (UID: "86b8c493-d5fc-44f8-9aba-1a30e8f2a82b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 27 17:00:52.930240 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:52.930100 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret podName:e726e51d-787e-4b3f-b003-ad105dd69b3e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:24.93007858 +0000 UTC m=+66.178715083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret") pod "global-pull-secret-syncer-m8xpw" (UID: "e726e51d-787e-4b3f-b003-ad105dd69b3e") : object "kube-system"/"original-pull-secret" not registered Jul 27 17:00:53.131223 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:53.131196 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:53.131335 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:53.131283 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 27 17:00:53.131335 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:53.131296 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 27 17:00:53.131335 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:53.131305 2558 projected.go:196] Error preparing data for projected volume kube-api-access-lbdcb for pod openshift-network-diagnostics/network-check-target-fzxxj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:53.131440 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:53.131344 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb podName:0cf5db6e-8a9f-4bed-bca3-873abc56cf26 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:25.131333193 +0000 UTC m=+66.379969658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lbdcb" (UniqueName: "kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb") pod "network-check-target-fzxxj" (UID: "0cf5db6e-8a9f-4bed-bca3-873abc56cf26") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 27 17:00:54.088779 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.088750 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-73.ec2.internal" event="NodeReady" Jul 27 17:00:54.089311 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.088865 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 27 17:00:54.168593 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.168564 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b555ffcb9-v777z"] Jul 27 17:00:54.172434 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.172416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.175175 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.175152 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6fpm7\"" Jul 27 17:00:54.175175 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.175162 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 27 17:00:54.175423 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.175407 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 27 17:00:54.175919 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.175898 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 27 17:00:54.182363 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.182337 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 27 17:00:54.193095 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.193075 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b555ffcb9-v777z"] Jul 27 17:00:54.194546 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.194528 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7nw2w"] Jul 27 17:00:54.198226 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.198208 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x9v8v"] Jul 27 17:00:54.198357 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.198339 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7nw2w" Jul 27 17:00:54.201316 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.201023 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 27 17:00:54.201316 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.201076 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 27 17:00:54.201316 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.201095 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gx4wt\"" Jul 27 17:00:54.201316 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.201031 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 27 17:00:54.201845 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.201831 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.204141 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.204123 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 27 17:00:54.204310 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.204290 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gsvqh\"" Jul 27 17:00:54.204419 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.204356 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 27 17:00:54.206189 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.206172 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7nw2w"] Jul 27 17:00:54.209231 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.209212 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9v8v"] Jul 27 17:00:54.241651 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.241630 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:00:54.241754 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.241730 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:00:54.242055 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.242036 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:00:54.245780 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.245756 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 17:00:54.246032 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.246017 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5w7g\"" Jul 27 17:00:54.246452 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.246436 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 17:00:54.247897 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.247877 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4q746\"" Jul 27 17:00:54.248182 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.248163 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 17:00:54.248366 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.248347 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 17:00:54.337999 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.337970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-bound-sa-token\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.338098 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338013 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkqs9\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-kube-api-access-rkqs9\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.338098 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-image-registry-private-configuration\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.338098 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338069 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.338098 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba6b380-8f10-4576-a94c-b351da05a1fd-cert\") pod \"ingress-canary-7nw2w\" (UID: \"0ba6b380-8f10-4576-a94c-b351da05a1fd\") " pod="openshift-ingress-canary/ingress-canary-7nw2w" Jul 27 17:00:54.338230 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1a7361-fe70-4825-82c5-28abfce0499a-tmp-dir\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.338230 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clklc\" (UniqueName: \"kubernetes.io/projected/1b1a7361-fe70-4825-82c5-28abfce0499a-kube-api-access-clklc\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.338230 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338184 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b1a7361-fe70-4825-82c5-28abfce0499a-config-volume\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.338230 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-certificates\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.338364 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-trusted-ca\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.338364 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338284 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-installation-pull-secrets\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.338364 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338319 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.338364 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8sbv\" (UniqueName: \"kubernetes.io/projected/0ba6b380-8f10-4576-a94c-b351da05a1fd-kube-api-access-g8sbv\") pod \"ingress-canary-7nw2w\" (UID: \"0ba6b380-8f10-4576-a94c-b351da05a1fd\") " pod="openshift-ingress-canary/ingress-canary-7nw2w" Jul 27 17:00:54.338480 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.338375 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f29f2a3-be88-4693-9137-4f98ea55dc9c-ca-trust-extracted\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.439529 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439441 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clklc\" (UniqueName: \"kubernetes.io/projected/1b1a7361-fe70-4825-82c5-28abfce0499a-kube-api-access-clklc\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.439529 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b1a7361-fe70-4825-82c5-28abfce0499a-config-volume\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.439717 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439551 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-certificates\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.439717 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-trusted-ca\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.439717 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-installation-pull-secrets\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.439717 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.439717 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8sbv\" (UniqueName: \"kubernetes.io/projected/0ba6b380-8f10-4576-a94c-b351da05a1fd-kube-api-access-g8sbv\") pod \"ingress-canary-7nw2w\" (UID: \"0ba6b380-8f10-4576-a94c-b351da05a1fd\") " pod="openshift-ingress-canary/ingress-canary-7nw2w" Jul 27 17:00:54.439900 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f29f2a3-be88-4693-9137-4f98ea55dc9c-ca-trust-extracted\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.439900 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-bound-sa-token\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.439900 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkqs9\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-kube-api-access-rkqs9\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.439900 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-image-registry-private-configuration\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.439900 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439835 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.439900 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba6b380-8f10-4576-a94c-b351da05a1fd-cert\") pod \"ingress-canary-7nw2w\" (UID: \"0ba6b380-8f10-4576-a94c-b351da05a1fd\") " pod="openshift-ingress-canary/ingress-canary-7nw2w" Jul 27 17:00:54.439900 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.439894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1a7361-fe70-4825-82c5-28abfce0499a-tmp-dir\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.440118 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.439897 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 17:00:54.440118 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.440026 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls podName:1b1a7361-fe70-4825-82c5-28abfce0499a nodeName:}" failed. No retries permitted until 2026-07-27 17:00:54.940006831 +0000 UTC m=+36.188643299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls") pod "dns-default-x9v8v" (UID: "1b1a7361-fe70-4825-82c5-28abfce0499a") : secret "dns-default-metrics-tls" not found Jul 27 17:00:54.440313 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.440290 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1b1a7361-fe70-4825-82c5-28abfce0499a-config-volume\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.440521 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.440483 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 17:00:54.440521 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.440518 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b555ffcb9-v777z: secret "image-registry-tls" not found Jul 27 17:00:54.440685 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.440565 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls podName:9f29f2a3-be88-4693-9137-4f98ea55dc9c nodeName:}" failed. No retries permitted until 2026-07-27 17:00:54.940547922 +0000 UTC m=+36.189184387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls") pod "image-registry-7b555ffcb9-v777z" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c") : secret "image-registry-tls" not found Jul 27 17:00:54.441285 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.440809 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-trusted-ca\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.441285 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.441032 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-certificates\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.441285 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.441140 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b1a7361-fe70-4825-82c5-28abfce0499a-tmp-dir\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.441285 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.441204 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f29f2a3-be88-4693-9137-4f98ea55dc9c-ca-trust-extracted\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.445440 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.445420 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-image-registry-private-configuration\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.445540 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.445422 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ba6b380-8f10-4576-a94c-b351da05a1fd-cert\") pod \"ingress-canary-7nw2w\" (UID: \"0ba6b380-8f10-4576-a94c-b351da05a1fd\") " pod="openshift-ingress-canary/ingress-canary-7nw2w" Jul 27 17:00:54.446907 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.446882 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-installation-pull-secrets\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.451649 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.451621 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8sbv\" (UniqueName: \"kubernetes.io/projected/0ba6b380-8f10-4576-a94c-b351da05a1fd-kube-api-access-g8sbv\") pod \"ingress-canary-7nw2w\" (UID: \"0ba6b380-8f10-4576-a94c-b351da05a1fd\") " pod="openshift-ingress-canary/ingress-canary-7nw2w" Jul 27 17:00:54.454891 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.452005 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-bound-sa-token\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.454891 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.452062 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clklc\" (UniqueName: \"kubernetes.io/projected/1b1a7361-fe70-4825-82c5-28abfce0499a-kube-api-access-clklc\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.454891 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.452868 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkqs9\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-kube-api-access-rkqs9\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.511783 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.511755 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7nw2w" Jul 27 17:00:54.674034 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.673634 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7nw2w"] Jul 27 17:00:54.677217 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:54.677188 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba6b380_8f10_4576_a94c_b351da05a1fd.slice/crio-b47c76c7256df450682da54be13c0d78030b319597cd80b47eb3967e99f394b1 WatchSource:0}: Error finding container b47c76c7256df450682da54be13c0d78030b319597cd80b47eb3967e99f394b1: Status 404 returned error can't find the container with id b47c76c7256df450682da54be13c0d78030b319597cd80b47eb3967e99f394b1 Jul 27 17:00:54.945140 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.945107 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:54.945307 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:54.945170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:54.945364 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.945326 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 17:00:54.945405 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.945394 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls podName:1b1a7361-fe70-4825-82c5-28abfce0499a nodeName:}" failed. No retries permitted until 2026-07-27 17:00:55.945374918 +0000 UTC m=+37.194011407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls") pod "dns-default-x9v8v" (UID: "1b1a7361-fe70-4825-82c5-28abfce0499a") : secret "dns-default-metrics-tls" not found Jul 27 17:00:54.945459 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.945419 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 17:00:54.945459 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.945440 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b555ffcb9-v777z: secret "image-registry-tls" not found Jul 27 17:00:54.945593 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:54.945492 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls podName:9f29f2a3-be88-4693-9137-4f98ea55dc9c nodeName:}" failed. No retries permitted until 2026-07-27 17:00:55.945475562 +0000 UTC m=+37.194112031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls") pod "image-registry-7b555ffcb9-v777z" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c") : secret "image-registry-tls" not found Jul 27 17:00:55.436811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:55.436775 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7nw2w" event={"ID":"0ba6b380-8f10-4576-a94c-b351da05a1fd","Type":"ContainerStarted","Data":"b47c76c7256df450682da54be13c0d78030b319597cd80b47eb3967e99f394b1"} Jul 27 17:00:55.949298 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:55.949261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:55.949489 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:55.949360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:55.949489 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:55.949424 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 17:00:55.949489 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:55.949442 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b555ffcb9-v777z: secret "image-registry-tls" not found Jul 27 17:00:55.949489 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:55.949459 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 17:00:55.949675 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:55.949494 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls podName:9f29f2a3-be88-4693-9137-4f98ea55dc9c nodeName:}" failed. No retries permitted until 2026-07-27 17:00:57.949477721 +0000 UTC m=+39.198114188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls") pod "image-registry-7b555ffcb9-v777z" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c") : secret "image-registry-tls" not found Jul 27 17:00:55.949675 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:55.949535 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls podName:1b1a7361-fe70-4825-82c5-28abfce0499a nodeName:}" failed. No retries permitted until 2026-07-27 17:00:57.949518628 +0000 UTC m=+39.198155107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls") pod "dns-default-x9v8v" (UID: "1b1a7361-fe70-4825-82c5-28abfce0499a") : secret "dns-default-metrics-tls" not found Jul 27 17:00:57.202404 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.202379 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt"] Jul 27 17:00:57.206419 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.206394 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt" Jul 27 17:00:57.208991 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.208965 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 27 17:00:57.210408 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.210239 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 27 17:00:57.210940 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.210918 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xnn8r\"" Jul 27 17:00:57.216477 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.216454 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt"] Jul 27 17:00:57.257450 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.257422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfdgw\" (UniqueName: \"kubernetes.io/projected/eb3a8bb5-ec0f-4fd2-a269-6e27cde15c45-kube-api-access-cfdgw\") pod \"volume-data-source-validator-549c6d54cf-7cpbt\" (UID: \"eb3a8bb5-ec0f-4fd2-a269-6e27cde15c45\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt" Jul 27 17:00:57.292112 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.292083 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj"] Jul 27 17:00:57.295149 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.295126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.295453 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.295427 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb"] Jul 27 17:00:57.298132 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.298107 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 27 17:00:57.298352 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.298336 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-6xlxh"] Jul 27 17:00:57.298540 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.298463 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 27 17:00:57.298540 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.298476 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zt7qf\"" Jul 27 17:00:57.299344 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.299310 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.299437 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.299388 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 27 17:00:57.301226 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.299767 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 27 17:00:57.304112 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.304070 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz"] Jul 27 17:00:57.304290 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.304275 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.304824 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.304797 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 27 17:00:57.304895 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.304850 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 27 17:00:57.304962 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.304946 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 27 17:00:57.305106 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.305089 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jj2sb\"" Jul 27 17:00:57.305637 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.305619 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 27 17:00:57.306867 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.306842 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 27 17:00:57.306963 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.306902 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 27 17:00:57.307164 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.307148 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4lcng\"" Jul 27 17:00:57.307217 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.307165 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 27 17:00:57.307460 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.307435 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 27 17:00:57.307549 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.307481 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hbw96"] Jul 27 17:00:57.307611 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.307571 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:00:57.314057 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.311714 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 27 17:00:57.314057 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.312549 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-blm4c\"" Jul 27 17:00:57.314057 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.313471 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj"] Jul 27 17:00:57.314057 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.313523 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb"] Jul 27 17:00:57.314057 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.313603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.314057 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.313647 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hbw96"] Jul 27 17:00:57.314057 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.313671 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 27 17:00:57.314422 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.314128 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 27 17:00:57.316005 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.315988 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-6xlxh"] Jul 27 17:00:57.316373 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.316354 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz"] Jul 27 17:00:57.316675 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.316651 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 27 17:00:57.317845 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.316859 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 27 17:00:57.317845 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.316875 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 27 17:00:57.317845 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.317135 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pt877\"" Jul 27 17:00:57.317845 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.317336 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 27 17:00:57.317845 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.317605 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 27 17:00:57.322767 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.322746 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 27 17:00:57.358915 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.358885 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:00:57.359025 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.358928 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfdgw\" (UniqueName: \"kubernetes.io/projected/eb3a8bb5-ec0f-4fd2-a269-6e27cde15c45-kube-api-access-cfdgw\") pod \"volume-data-source-validator-549c6d54cf-7cpbt\" (UID: \"eb3a8bb5-ec0f-4fd2-a269-6e27cde15c45\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt" Jul 27 17:00:57.359025 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.358948 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-config\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.359025 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.358974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-trusted-ca\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.359025 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.358997 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccvn2\" (UniqueName: \"kubernetes.io/projected/beafa525-e855-4bb3-8b86-d93611b2f2c1-kube-api-access-ccvn2\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.359025 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359018 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa39d2c-ea50-4534-849f-c7a48af88694-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/592d9913-e610-4245-9cea-5d505993746e-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj\" (UID: \"592d9913-e610-4245-9cea-5d505993746e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359098 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa39d2c-ea50-4534-849f-c7a48af88694-serving-cert\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359115 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/beafa525-e855-4bb3-8b86-d93611b2f2c1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359133 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffa39d2c-ea50-4534-849f-c7a48af88694-tmp\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359153 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa39d2c-ea50-4534-849f-c7a48af88694-service-ca-bundle\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359185 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zf69\" (UniqueName: \"kubernetes.io/projected/592d9913-e610-4245-9cea-5d505993746e-kube-api-access-5zf69\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj\" (UID: \"592d9913-e610-4245-9cea-5d505993746e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn62j\" (UniqueName: \"kubernetes.io/projected/ffa39d2c-ea50-4534-849f-c7a48af88694-kube-api-access-kn62j\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359221 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-serving-cert\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359236 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ffa39d2c-ea50-4534-849f-c7a48af88694-snapshots\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wmdq\" (UniqueName: \"kubernetes.io/projected/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-kube-api-access-9wmdq\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359268 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ctn7\" (UniqueName: \"kubernetes.io/projected/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-kube-api-access-5ctn7\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:00:57.359286 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.359283 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/592d9913-e610-4245-9cea-5d505993746e-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj\" (UID: \"592d9913-e610-4245-9cea-5d505993746e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.370641 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.370614 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfdgw\" (UniqueName: \"kubernetes.io/projected/eb3a8bb5-ec0f-4fd2-a269-6e27cde15c45-kube-api-access-cfdgw\") pod \"volume-data-source-validator-549c6d54cf-7cpbt\" (UID: \"eb3a8bb5-ec0f-4fd2-a269-6e27cde15c45\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt" Jul 27 17:00:57.393483 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.393456 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm"] Jul 27 17:00:57.396549 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.396528 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.399332 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.399311 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9l5vd\"" Jul 27 17:00:57.399840 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.399815 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 27 17:00:57.400774 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.400753 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54886598f-4vhvf"] Jul 27 17:00:57.400921 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.400897 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 27 17:00:57.401024 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.401001 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 27 17:00:57.401094 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.401072 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 27 17:00:57.405323 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.404837 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.408519 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.408477 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm"] Jul 27 17:00:57.409682 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.409666 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 27 17:00:57.409817 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.409802 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 27 17:00:57.409897 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.409710 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 27 17:00:57.410032 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.410017 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8grpq\"" Jul 27 17:00:57.410188 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.410167 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 27 17:00:57.410317 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.410196 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 27 17:00:57.410404 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.410223 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 27 17:00:57.417466 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.417442 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54886598f-4vhvf"] Jul 27 17:00:57.445128 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.445073 2558 generic.go:356] "Generic (PLEG): container finished" podID="3155d2f3-4f29-4286-822a-c219199aa133" containerID="8b1e84c24b72c26684cd14fff0b77a72fd47261790e636e43b8a3fb1ac5f1fc4" exitCode=0 Jul 27 17:00:57.445128 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.445123 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cg26" event={"ID":"3155d2f3-4f29-4286-822a-c219199aa133","Type":"ContainerDied","Data":"8b1e84c24b72c26684cd14fff0b77a72fd47261790e636e43b8a3fb1ac5f1fc4"} Jul 27 17:00:57.459832 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.459811 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.459929 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.459851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/100ca857-21a7-405d-8a84-4ecdda1e8655-serving-cert\") pod \"service-ca-operator-5d6c75f84f-bzhbm\" (UID: \"100ca857-21a7-405d-8a84-4ecdda1e8655\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.459929 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.459879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:00:57.460031 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.459928 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-config\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.460031 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.459964 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 17:00:57.460031 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.459980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-trusted-ca\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.460031 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.460014 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls podName:d9742883-9cdb-4a8f-98bf-cc8fef7f070c nodeName:}" failed. No retries permitted until 2026-07-27 17:00:57.95999579 +0000 UTC m=+39.208632261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls") pod "cluster-samples-operator-6748489656-qljqz" (UID: "d9742883-9cdb-4a8f-98bf-cc8fef7f070c") : secret "samples-operator-tls" not found Jul 27 17:00:57.460201 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460041 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccvn2\" (UniqueName: \"kubernetes.io/projected/beafa525-e855-4bb3-8b86-d93611b2f2c1-kube-api-access-ccvn2\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.460201 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa39d2c-ea50-4534-849f-c7a48af88694-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.460201 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqh9p\" (UniqueName: \"kubernetes.io/projected/55886cbf-490e-45fb-9a50-ba190b8b3f15-kube-api-access-lqh9p\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.460201 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.460201 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.460181 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 17:00:57.460431 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.460212 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls podName:beafa525-e855-4bb3-8b86-d93611b2f2c1 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:57.960203418 +0000 UTC m=+39.208839883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f95gb" (UID: "beafa525-e855-4bb3-8b86-d93611b2f2c1") : secret "cluster-monitoring-operator-tls" not found Jul 27 17:00:57.460431 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-default-certificate\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.460431 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460356 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/592d9913-e610-4245-9cea-5d505993746e-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj\" (UID: \"592d9913-e610-4245-9cea-5d505993746e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.460431 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/100ca857-21a7-405d-8a84-4ecdda1e8655-config\") pod \"service-ca-operator-5d6c75f84f-bzhbm\" (UID: \"100ca857-21a7-405d-8a84-4ecdda1e8655\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.460655 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa39d2c-ea50-4534-849f-c7a48af88694-serving-cert\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.460655 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460480 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/beafa525-e855-4bb3-8b86-d93611b2f2c1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.460655 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460527 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffa39d2c-ea50-4534-849f-c7a48af88694-tmp\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.460655 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa39d2c-ea50-4534-849f-c7a48af88694-service-ca-bundle\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.460655 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzhr8\" (UniqueName: \"kubernetes.io/projected/100ca857-21a7-405d-8a84-4ecdda1e8655-kube-api-access-hzhr8\") pod \"service-ca-operator-5d6c75f84f-bzhbm\" (UID: \"100ca857-21a7-405d-8a84-4ecdda1e8655\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.460655 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zf69\" (UniqueName: \"kubernetes.io/projected/592d9913-e610-4245-9cea-5d505993746e-kube-api-access-5zf69\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj\" (UID: \"592d9913-e610-4245-9cea-5d505993746e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.460941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460665 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn62j\" (UniqueName: \"kubernetes.io/projected/ffa39d2c-ea50-4534-849f-c7a48af88694-kube-api-access-kn62j\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.460941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-serving-cert\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.460941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ffa39d2c-ea50-4534-849f-c7a48af88694-snapshots\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.460941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.460941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460766 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wmdq\" (UniqueName: \"kubernetes.io/projected/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-kube-api-access-9wmdq\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.460941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460807 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ctn7\" (UniqueName: \"kubernetes.io/projected/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-kube-api-access-5ctn7\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:00:57.460941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/592d9913-e610-4245-9cea-5d505993746e-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj\" (UID: \"592d9913-e610-4245-9cea-5d505993746e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.460941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460865 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-stats-auth\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.461307 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.460968 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/592d9913-e610-4245-9cea-5d505993746e-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj\" (UID: \"592d9913-e610-4245-9cea-5d505993746e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.461307 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.461021 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-config\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.461307 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.461221 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-trusted-ca\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.462269 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.461601 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ffa39d2c-ea50-4534-849f-c7a48af88694-snapshots\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.462269 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.461921 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa39d2c-ea50-4534-849f-c7a48af88694-service-ca-bundle\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.462269 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.461972 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffa39d2c-ea50-4534-849f-c7a48af88694-tmp\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.462269 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.462145 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/beafa525-e855-4bb3-8b86-d93611b2f2c1-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.462269 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.462240 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa39d2c-ea50-4534-849f-c7a48af88694-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.463842 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.463817 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/592d9913-e610-4245-9cea-5d505993746e-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj\" (UID: \"592d9913-e610-4245-9cea-5d505993746e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.463915 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.463862 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ffa39d2c-ea50-4534-849f-c7a48af88694-serving-cert\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.463915 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.463876 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-serving-cert\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.471423 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.471398 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wmdq\" (UniqueName: \"kubernetes.io/projected/74763785-12fb-4fe1-9f3f-d0d18ff33ecb-kube-api-access-9wmdq\") pod \"console-operator-584dcb6b54-6xlxh\" (UID: \"74763785-12fb-4fe1-9f3f-d0d18ff33ecb\") " pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.475816 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.475772 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccvn2\" (UniqueName: \"kubernetes.io/projected/beafa525-e855-4bb3-8b86-d93611b2f2c1-kube-api-access-ccvn2\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.478748 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.478710 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zf69\" (UniqueName: \"kubernetes.io/projected/592d9913-e610-4245-9cea-5d505993746e-kube-api-access-5zf69\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj\" (UID: \"592d9913-e610-4245-9cea-5d505993746e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.480064 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.480044 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn62j\" (UniqueName: \"kubernetes.io/projected/ffa39d2c-ea50-4534-849f-c7a48af88694-kube-api-access-kn62j\") pod \"insights-operator-5885fdb759-hbw96\" (UID: \"ffa39d2c-ea50-4534-849f-c7a48af88694\") " pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.481559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.481536 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ctn7\" (UniqueName: \"kubernetes.io/projected/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-kube-api-access-5ctn7\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:00:57.519387 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.519361 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt" Jul 27 17:00:57.561438 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.561416 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzhr8\" (UniqueName: \"kubernetes.io/projected/100ca857-21a7-405d-8a84-4ecdda1e8655-kube-api-access-hzhr8\") pod \"service-ca-operator-5d6c75f84f-bzhbm\" (UID: \"100ca857-21a7-405d-8a84-4ecdda1e8655\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.561563 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.561459 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.561563 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.561488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-stats-auth\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.561664 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.561603 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.561664 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.561648 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/100ca857-21a7-405d-8a84-4ecdda1e8655-serving-cert\") pod \"service-ca-operator-5d6c75f84f-bzhbm\" (UID: \"100ca857-21a7-405d-8a84-4ecdda1e8655\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.561746 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.561727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqh9p\" (UniqueName: \"kubernetes.io/projected/55886cbf-490e-45fb-9a50-ba190b8b3f15-kube-api-access-lqh9p\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.561789 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.561774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-default-certificate\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.561855 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.561836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/100ca857-21a7-405d-8a84-4ecdda1e8655-config\") pod \"service-ca-operator-5d6c75f84f-bzhbm\" (UID: \"100ca857-21a7-405d-8a84-4ecdda1e8655\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.561899 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.561876 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 17:00:57.561951 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.561939 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:58.06191946 +0000 UTC m=+39.310555926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : secret "router-metrics-certs-default" not found Jul 27 17:00:57.562231 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.562213 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:58.062198295 +0000 UTC m=+39.310834783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : configmap references non-existent config key: service-ca.crt Jul 27 17:00:57.562452 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.562434 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/100ca857-21a7-405d-8a84-4ecdda1e8655-config\") pod \"service-ca-operator-5d6c75f84f-bzhbm\" (UID: \"100ca857-21a7-405d-8a84-4ecdda1e8655\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.565121 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.565070 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/100ca857-21a7-405d-8a84-4ecdda1e8655-serving-cert\") pod \"service-ca-operator-5d6c75f84f-bzhbm\" (UID: \"100ca857-21a7-405d-8a84-4ecdda1e8655\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.565909 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.565887 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-stats-auth\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.567180 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.566927 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-default-certificate\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.572514 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.572455 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzhr8\" (UniqueName: \"kubernetes.io/projected/100ca857-21a7-405d-8a84-4ecdda1e8655-kube-api-access-hzhr8\") pod \"service-ca-operator-5d6c75f84f-bzhbm\" (UID: \"100ca857-21a7-405d-8a84-4ecdda1e8655\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.573359 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.573317 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqh9p\" (UniqueName: \"kubernetes.io/projected/55886cbf-490e-45fb-9a50-ba190b8b3f15-kube-api-access-lqh9p\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:57.609307 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.609282 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" Jul 27 17:00:57.627628 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.627436 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:00:57.638808 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.638782 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-hbw96" Jul 27 17:00:57.667069 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.667047 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt"] Jul 27 17:00:57.671835 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:57.671798 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3a8bb5_ec0f_4fd2_a269_6e27cde15c45.slice/crio-c950b5c587052ca2fd5a8e50b4d414051a04e914453a1a1c359ceb146ad309b9 WatchSource:0}: Error finding container c950b5c587052ca2fd5a8e50b4d414051a04e914453a1a1c359ceb146ad309b9: Status 404 returned error can't find the container with id c950b5c587052ca2fd5a8e50b4d414051a04e914453a1a1c359ceb146ad309b9 Jul 27 17:00:57.709007 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.708705 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" Jul 27 17:00:57.845521 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.845471 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-6xlxh"] Jul 27 17:00:57.852808 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:57.852770 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74763785_12fb_4fe1_9f3f_d0d18ff33ecb.slice/crio-f6f87f09bb20bbcb99ae269289fc74cadab01bbfc87063f126ebc33a3d46b47b WatchSource:0}: Error finding container f6f87f09bb20bbcb99ae269289fc74cadab01bbfc87063f126ebc33a3d46b47b: Status 404 returned error can't find the container with id f6f87f09bb20bbcb99ae269289fc74cadab01bbfc87063f126ebc33a3d46b47b Jul 27 17:00:57.859004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.858952 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj"] Jul 27 17:00:57.863046 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:57.861286 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592d9913_e610_4245_9cea_5d505993746e.slice/crio-fdec0f3b4e6fea4f9544b357c8ecbf926241413b2d83966d214384c33f9d2226 WatchSource:0}: Error finding container fdec0f3b4e6fea4f9544b357c8ecbf926241413b2d83966d214384c33f9d2226: Status 404 returned error can't find the container with id fdec0f3b4e6fea4f9544b357c8ecbf926241413b2d83966d214384c33f9d2226 Jul 27 17:00:57.863046 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.863023 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-hbw96"] Jul 27 17:00:57.865076 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:57.865047 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa39d2c_ea50_4534_849f_c7a48af88694.slice/crio-7462aa2a6ea44e28f83cef9bd5526100d773e45a188164576226bd410072fbf6 WatchSource:0}: Error finding container 7462aa2a6ea44e28f83cef9bd5526100d773e45a188164576226bd410072fbf6: Status 404 returned error can't find the container with id 7462aa2a6ea44e28f83cef9bd5526100d773e45a188164576226bd410072fbf6 Jul 27 17:00:57.890932 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.890909 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm"] Jul 27 17:00:57.894144 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:00:57.894122 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100ca857_21a7_405d_8a84_4ecdda1e8655.slice/crio-f2e8008170fcb119682109080e6412f3edb93194da9330159a91819df3dc6564 WatchSource:0}: Error finding container f2e8008170fcb119682109080e6412f3edb93194da9330159a91819df3dc6564: Status 404 returned error can't find the container with id f2e8008170fcb119682109080e6412f3edb93194da9330159a91819df3dc6564 Jul 27 17:00:57.965356 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.965302 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:00:57.965356 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.965342 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:00:57.965525 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.965372 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:57.965525 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:57.965399 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:00:57.965525 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.965458 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 17:00:57.965525 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.965460 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 17:00:57.965715 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.965542 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls podName:d9742883-9cdb-4a8f-98bf-cc8fef7f070c nodeName:}" failed. No retries permitted until 2026-07-27 17:00:58.965521851 +0000 UTC m=+40.214158332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls") pod "cluster-samples-operator-6748489656-qljqz" (UID: "d9742883-9cdb-4a8f-98bf-cc8fef7f070c") : secret "samples-operator-tls" not found Jul 27 17:00:57.965715 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.965544 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 17:00:57.965715 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.965547 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 17:00:57.965715 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.965562 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls podName:1b1a7361-fe70-4825-82c5-28abfce0499a nodeName:}" failed. No retries permitted until 2026-07-27 17:01:01.965552381 +0000 UTC m=+43.214188848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls") pod "dns-default-x9v8v" (UID: "1b1a7361-fe70-4825-82c5-28abfce0499a") : secret "dns-default-metrics-tls" not found Jul 27 17:00:57.965715 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.965565 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b555ffcb9-v777z: secret "image-registry-tls" not found Jul 27 17:00:57.965715 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.965594 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls podName:beafa525-e855-4bb3-8b86-d93611b2f2c1 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:58.965580065 +0000 UTC m=+40.214216533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f95gb" (UID: "beafa525-e855-4bb3-8b86-d93611b2f2c1") : secret "cluster-monitoring-operator-tls" not found Jul 27 17:00:57.965715 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:57.965610 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls podName:9f29f2a3-be88-4693-9137-4f98ea55dc9c nodeName:}" failed. No retries permitted until 2026-07-27 17:01:01.965601511 +0000 UTC m=+43.214237978 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls") pod "image-registry-7b555ffcb9-v777z" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c") : secret "image-registry-tls" not found Jul 27 17:00:58.066022 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.065987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:58.066132 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.066043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:58.066196 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:58.066150 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:59.066133712 +0000 UTC m=+40.314770201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : configmap references non-existent config key: service-ca.crt Jul 27 17:00:58.066196 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:58.066163 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 17:00:58.066301 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:58.066210 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:00:59.066193815 +0000 UTC m=+40.314830279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : secret "router-metrics-certs-default" not found Jul 27 17:00:58.450272 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.450205 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" event={"ID":"100ca857-21a7-405d-8a84-4ecdda1e8655","Type":"ContainerStarted","Data":"f2e8008170fcb119682109080e6412f3edb93194da9330159a91819df3dc6564"} Jul 27 17:00:58.452349 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.452319 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hbw96" event={"ID":"ffa39d2c-ea50-4534-849f-c7a48af88694","Type":"ContainerStarted","Data":"7462aa2a6ea44e28f83cef9bd5526100d773e45a188164576226bd410072fbf6"} Jul 27 17:00:58.454560 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.454534 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" event={"ID":"74763785-12fb-4fe1-9f3f-d0d18ff33ecb","Type":"ContainerStarted","Data":"f6f87f09bb20bbcb99ae269289fc74cadab01bbfc87063f126ebc33a3d46b47b"} Jul 27 17:00:58.456444 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.456419 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt" event={"ID":"eb3a8bb5-ec0f-4fd2-a269-6e27cde15c45","Type":"ContainerStarted","Data":"c950b5c587052ca2fd5a8e50b4d414051a04e914453a1a1c359ceb146ad309b9"} Jul 27 17:00:58.459930 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.459906 2558 generic.go:356] "Generic (PLEG): container finished" podID="3155d2f3-4f29-4286-822a-c219199aa133" containerID="9cb8bd3a9887f45be9b12ba4e80580716b6102f32a5fad3b392a57c8106fed5d" exitCode=0 Jul 27 17:00:58.460016 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.459981 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cg26" event={"ID":"3155d2f3-4f29-4286-822a-c219199aa133","Type":"ContainerDied","Data":"9cb8bd3a9887f45be9b12ba4e80580716b6102f32a5fad3b392a57c8106fed5d"} Jul 27 17:00:58.462190 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.462168 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" event={"ID":"592d9913-e610-4245-9cea-5d505993746e","Type":"ContainerStarted","Data":"fdec0f3b4e6fea4f9544b357c8ecbf926241413b2d83966d214384c33f9d2226"} Jul 27 17:00:58.980567 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.980013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:00:58.980567 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:58.980112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:00:58.980567 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:58.980348 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 17:00:58.980567 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:58.980433 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls podName:d9742883-9cdb-4a8f-98bf-cc8fef7f070c nodeName:}" failed. No retries permitted until 2026-07-27 17:01:00.980410459 +0000 UTC m=+42.229046927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls") pod "cluster-samples-operator-6748489656-qljqz" (UID: "d9742883-9cdb-4a8f-98bf-cc8fef7f070c") : secret "samples-operator-tls" not found Jul 27 17:00:58.980567 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:58.980436 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 17:00:58.980567 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:58.980524 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls podName:beafa525-e855-4bb3-8b86-d93611b2f2c1 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:00.980484847 +0000 UTC m=+42.229121332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f95gb" (UID: "beafa525-e855-4bb3-8b86-d93611b2f2c1") : secret "cluster-monitoring-operator-tls" not found Jul 27 17:00:59.082334 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:59.081675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:59.082334 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:59.081743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:00:59.082334 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:59.081871 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 17:00:59.082334 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:59.081929 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:01.081910859 +0000 UTC m=+42.330547328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : secret "router-metrics-certs-default" not found Jul 27 17:00:59.082334 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:00:59.082293 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:01.082275043 +0000 UTC m=+42.330911511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : configmap references non-existent config key: service-ca.crt Jul 27 17:00:59.473135 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:59.472359 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cg26" event={"ID":"3155d2f3-4f29-4286-822a-c219199aa133","Type":"ContainerStarted","Data":"7b140096b95ad0380417aa70907ae811df387fbada748a76923bf55be0b8d56b"} Jul 27 17:00:59.499365 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:00:59.499313 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4cg26" podStartSLOduration=10.784232284 podStartE2EDuration="39.499294747s" totalImagesPullingTime="28.715062463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:00:59.498331496 +0000 UTC m=+40.746967983" watchObservedRunningTime="2026-07-27 17:00:59.499294747 +0000 UTC m=+40.747931228" Jul 27 17:01:00.997764 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:00.997718 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:01:00.998129 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:00.997804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:01:00.998129 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:00.997877 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 17:01:00.998129 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:00.997889 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 17:01:00.998129 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:00.997933 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls podName:beafa525-e855-4bb3-8b86-d93611b2f2c1 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:04.99791992 +0000 UTC m=+46.246556385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f95gb" (UID: "beafa525-e855-4bb3-8b86-d93611b2f2c1") : secret "cluster-monitoring-operator-tls" not found Jul 27 17:01:00.998129 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:00.998024 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls podName:d9742883-9cdb-4a8f-98bf-cc8fef7f070c nodeName:}" failed. No retries permitted until 2026-07-27 17:01:04.998010063 +0000 UTC m=+46.246646528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls") pod "cluster-samples-operator-6748489656-qljqz" (UID: "d9742883-9cdb-4a8f-98bf-cc8fef7f070c") : secret "samples-operator-tls" not found Jul 27 17:01:01.098870 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:01.098840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:01.099011 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:01.098969 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:01.099011 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:01.098977 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 17:01:01.099094 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:01.099028 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:05.099012993 +0000 UTC m=+46.347649458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : secret "router-metrics-certs-default" not found Jul 27 17:01:01.099094 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:01.099077 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:05.099062317 +0000 UTC m=+46.347698784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : configmap references non-existent config key: service-ca.crt Jul 27 17:01:02.005612 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:02.005575 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:01:02.006030 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:02.005633 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:01:02.006030 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:02.005719 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 17:01:02.006030 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:02.005726 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 17:01:02.006030 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:02.005731 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b555ffcb9-v777z: secret "image-registry-tls" not found Jul 27 17:01:02.006030 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:02.005790 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls podName:1b1a7361-fe70-4825-82c5-28abfce0499a nodeName:}" failed. No retries permitted until 2026-07-27 17:01:10.005775555 +0000 UTC m=+51.254412020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls") pod "dns-default-x9v8v" (UID: "1b1a7361-fe70-4825-82c5-28abfce0499a") : secret "dns-default-metrics-tls" not found Jul 27 17:01:02.006030 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:02.005823 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls podName:9f29f2a3-be88-4693-9137-4f98ea55dc9c nodeName:}" failed. No retries permitted until 2026-07-27 17:01:10.005816793 +0000 UTC m=+51.254453258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls") pod "image-registry-7b555ffcb9-v777z" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c") : secret "image-registry-tls" not found Jul 27 17:01:04.488044 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.488007 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7nw2w" event={"ID":"0ba6b380-8f10-4576-a94c-b351da05a1fd","Type":"ContainerStarted","Data":"13791e74deed70ad643c344365728f1edbb58b856bf9c5997741946f42eab500"} Jul 27 17:01:04.489519 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.489481 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" event={"ID":"100ca857-21a7-405d-8a84-4ecdda1e8655","Type":"ContainerStarted","Data":"f8d71cca2a04329f0d75752155e41aed9ed96ce15c06c484de79711e3ccd5f20"} Jul 27 17:01:04.491124 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.491095 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hbw96" event={"ID":"ffa39d2c-ea50-4534-849f-c7a48af88694","Type":"ContainerStarted","Data":"d1ac119f7b6221ad9eac345eca0a4b7a1a9ab5a25f47726df4d267c2942f7d27"} Jul 27 17:01:04.492896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.492873 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/0.log" Jul 27 17:01:04.493001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.492915 2558 generic.go:356] "Generic (PLEG): container finished" podID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" containerID="b6ece22700496776bb9e2978bd2b661d9d89371336b60eedd50aea786cd41e54" exitCode=255 Jul 27 17:01:04.493001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.492990 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" event={"ID":"74763785-12fb-4fe1-9f3f-d0d18ff33ecb","Type":"ContainerDied","Data":"b6ece22700496776bb9e2978bd2b661d9d89371336b60eedd50aea786cd41e54"} Jul 27 17:01:04.493177 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.493160 2558 scope.go:117] "RemoveContainer" containerID="b6ece22700496776bb9e2978bd2b661d9d89371336b60eedd50aea786cd41e54" Jul 27 17:01:04.495642 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.495620 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt" event={"ID":"eb3a8bb5-ec0f-4fd2-a269-6e27cde15c45","Type":"ContainerStarted","Data":"bac0e71267ad92da29984e953900c2c04bee01aa83172b0b02393c61961eb889"} Jul 27 17:01:04.497167 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.497145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" event={"ID":"592d9913-e610-4245-9cea-5d505993746e","Type":"ContainerStarted","Data":"e8bdee1e4d3c644d726ada562c728f80640bdcdaba1989aacf968f83abac5b55"} Jul 27 17:01:04.507225 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.507174 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7nw2w" podStartSLOduration=1.26312332 podStartE2EDuration="10.507156945s" totalImagesPullingTime="9.244033625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:04.506062877 +0000 UTC m=+45.754699362" watchObservedRunningTime="2026-07-27 17:01:04.507156945 +0000 UTC m=+45.755793433" Jul 27 17:01:04.521825 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.521780 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7cpbt" podStartSLOduration=1.2740707549999999 podStartE2EDuration="7.52176362s" totalImagesPullingTime="6.247692865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:04.521637224 +0000 UTC m=+45.770273711" watchObservedRunningTime="2026-07-27 17:01:04.52176362 +0000 UTC m=+45.770400108" Jul 27 17:01:04.562968 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.562923 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" podStartSLOduration=1.503488639 podStartE2EDuration="7.562905189s" totalImagesPullingTime="6.05941655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:04.561494706 +0000 UTC m=+45.810131195" watchObservedRunningTime="2026-07-27 17:01:04.562905189 +0000 UTC m=+45.811541656" Jul 27 17:01:04.582421 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.582382 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-hbw96" podStartSLOduration=1.5256632589999999 podStartE2EDuration="7.582369334s" totalImagesPullingTime="6.056706075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:04.58186408 +0000 UTC m=+45.830500568" watchObservedRunningTime="2026-07-27 17:01:04.582369334 +0000 UTC m=+45.831005822" Jul 27 17:01:04.604848 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:04.604808 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" podStartSLOduration=1.57075455 podStartE2EDuration="7.604795244s" totalImagesPullingTime="6.034040694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:04.604198054 +0000 UTC m=+45.852834541" watchObservedRunningTime="2026-07-27 17:01:04.604795244 +0000 UTC m=+45.853431731" Jul 27 17:01:05.030694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.030661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:01:05.030829 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.030750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:01:05.030829 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.030814 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 27 17:01:05.030934 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.030858 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 17:01:05.030934 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.030882 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls podName:d9742883-9cdb-4a8f-98bf-cc8fef7f070c nodeName:}" failed. No retries permitted until 2026-07-27 17:01:13.030867662 +0000 UTC m=+54.279504129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls") pod "cluster-samples-operator-6748489656-qljqz" (UID: "d9742883-9cdb-4a8f-98bf-cc8fef7f070c") : secret "samples-operator-tls" not found Jul 27 17:01:05.030934 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.030910 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls podName:beafa525-e855-4bb3-8b86-d93611b2f2c1 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:13.030893563 +0000 UTC m=+54.279530033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f95gb" (UID: "beafa525-e855-4bb3-8b86-d93611b2f2c1") : secret "cluster-monitoring-operator-tls" not found Jul 27 17:01:05.131755 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.131725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:05.131901 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.131840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:05.131959 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.131894 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 17:01:05.131959 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.131932 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:13.13191985 +0000 UTC m=+54.380556316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : configmap references non-existent config key: service-ca.crt Jul 27 17:01:05.131959 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.131954 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:13.131938747 +0000 UTC m=+54.380575218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : secret "router-metrics-certs-default" not found Jul 27 17:01:05.229789 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.229700 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cj8v2"] Jul 27 17:01:05.253366 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.253319 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cj8v2"] Jul 27 17:01:05.254404 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.254376 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.260543 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.260519 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8tdwq\"" Jul 27 17:01:05.260781 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.260762 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 27 17:01:05.261913 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.261836 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 27 17:01:05.332829 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.332807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-crio-socket\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.332928 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.332875 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.332928 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.332916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcwvp\" (UniqueName: \"kubernetes.io/projected/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-api-access-wcwvp\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.333037 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.332989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.333097 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.333081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-data-volume\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.433712 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.433680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.433822 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.433736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcwvp\" (UniqueName: \"kubernetes.io/projected/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-api-access-wcwvp\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.433822 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.433771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.433822 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.433795 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 17:01:05.433822 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.433809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-data-volume\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.433962 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.433865 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm podName:9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:05.93384376 +0000 UTC m=+47.182480233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cj8v2" (UID: "9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e") : configmap "kube-rbac-proxy" not found Jul 27 17:01:05.433962 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.433898 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 17:01:05.433962 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.433938 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls podName:9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:05.933926436 +0000 UTC m=+47.182562901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj8v2" (UID: "9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e") : secret "insights-runtime-extractor-tls" not found Jul 27 17:01:05.434073 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.433975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-crio-socket\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.434132 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.434084 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-data-volume\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.434132 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.434114 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-crio-socket\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.445185 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.445167 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcwvp\" (UniqueName: \"kubernetes.io/projected/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-api-access-wcwvp\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.501979 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.501927 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/1.log" Jul 27 17:01:05.502353 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.502341 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/0.log" Jul 27 17:01:05.502399 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.502373 2558 generic.go:356] "Generic (PLEG): container finished" podID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" containerID="8b95c2a943293d6502e2195d07a2a298fd584b5235a87afc728e0d0e2bd62f5e" exitCode=255 Jul 27 17:01:05.502460 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.502445 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" event={"ID":"74763785-12fb-4fe1-9f3f-d0d18ff33ecb","Type":"ContainerDied","Data":"8b95c2a943293d6502e2195d07a2a298fd584b5235a87afc728e0d0e2bd62f5e"} Jul 27 17:01:05.502527 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.502490 2558 scope.go:117] "RemoveContainer" containerID="b6ece22700496776bb9e2978bd2b661d9d89371336b60eedd50aea786cd41e54" Jul 27 17:01:05.502697 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.502674 2558 scope.go:117] "RemoveContainer" containerID="8b95c2a943293d6502e2195d07a2a298fd584b5235a87afc728e0d0e2bd62f5e" Jul 27 17:01:05.502883 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.502860 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-6xlxh_openshift-console-operator(74763785-12fb-4fe1-9f3f-d0d18ff33ecb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" podUID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" Jul 27 17:01:05.937984 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.937957 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.938109 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:05.938010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:05.938109 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.938076 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 17:01:05.938109 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.938100 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 17:01:05.938217 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.938139 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm podName:9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:06.938124398 +0000 UTC m=+48.186760862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cj8v2" (UID: "9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e") : configmap "kube-rbac-proxy" not found Jul 27 17:01:05.938217 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:05.938153 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls podName:9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:06.938146737 +0000 UTC m=+48.186783201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj8v2" (UID: "9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e") : secret "insights-runtime-extractor-tls" not found Jul 27 17:01:06.509184 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:06.509159 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/1.log" Jul 27 17:01:06.509590 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:06.509430 2558 scope.go:117] "RemoveContainer" containerID="8b95c2a943293d6502e2195d07a2a298fd584b5235a87afc728e0d0e2bd62f5e" Jul 27 17:01:06.509590 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:06.509583 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-6xlxh_openshift-console-operator(74763785-12fb-4fe1-9f3f-d0d18ff33ecb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" podUID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" Jul 27 17:01:06.832752 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:06.832728 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r6s2z_2e47f535-d51d-4a76-a64d-0fe4d83316fa/dns-node-resolver/0.log" Jul 27 17:01:06.946115 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:06.946087 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:06.946228 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:06.946142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:06.946228 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:06.946202 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 17:01:06.946309 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:06.946257 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm podName:9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:08.946241724 +0000 UTC m=+50.194878188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cj8v2" (UID: "9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e") : configmap "kube-rbac-proxy" not found Jul 27 17:01:06.946309 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:06.946301 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 17:01:06.946382 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:06.946370 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls podName:9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:08.946357542 +0000 UTC m=+50.194994007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj8v2" (UID: "9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e") : secret "insights-runtime-extractor-tls" not found Jul 27 17:01:07.627886 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:07.627858 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:01:07.628232 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:07.627911 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:01:07.628301 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:07.628268 2558 scope.go:117] "RemoveContainer" containerID="8b95c2a943293d6502e2195d07a2a298fd584b5235a87afc728e0d0e2bd62f5e" Jul 27 17:01:07.628442 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:07.628421 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-6xlxh_openshift-console-operator(74763785-12fb-4fe1-9f3f-d0d18ff33ecb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" podUID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" Jul 27 17:01:07.633467 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:07.633451 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k9z9x_c0e3a68f-bcfd-4f6a-9663-a60146e7b64a/node-ca/0.log" Jul 27 17:01:08.634299 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:08.634269 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7nw2w_0ba6b380-8f10-4576-a94c-b351da05a1fd/serve-healthcheck-canary/0.log" Jul 27 17:01:08.962290 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:08.962223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:08.962423 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:08.962364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:08.962423 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:08.962381 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 17:01:08.962497 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:08.962439 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 27 17:01:08.962497 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:08.962450 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls podName:9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:12.962431681 +0000 UTC m=+54.211068164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj8v2" (UID: "9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e") : secret "insights-runtime-extractor-tls" not found Jul 27 17:01:08.962497 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:08.962475 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm podName:9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:12.962464444 +0000 UTC m=+54.211100909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cj8v2" (UID: "9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e") : configmap "kube-rbac-proxy" not found Jul 27 17:01:10.069335 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:10.069302 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:01:10.069792 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:10.069361 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:01:10.069792 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:10.069462 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 27 17:01:10.069792 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:10.069561 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls podName:1b1a7361-fe70-4825-82c5-28abfce0499a nodeName:}" failed. No retries permitted until 2026-07-27 17:01:26.069538077 +0000 UTC m=+67.318174548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls") pod "dns-default-x9v8v" (UID: "1b1a7361-fe70-4825-82c5-28abfce0499a") : secret "dns-default-metrics-tls" not found Jul 27 17:01:10.069792 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:10.069582 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 27 17:01:10.069792 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:10.069598 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b555ffcb9-v777z: secret "image-registry-tls" not found Jul 27 17:01:10.069792 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:10.069643 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls podName:9f29f2a3-be88-4693-9137-4f98ea55dc9c nodeName:}" failed. No retries permitted until 2026-07-27 17:01:26.069628753 +0000 UTC m=+67.318265218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls") pod "image-registry-7b555ffcb9-v777z" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c") : secret "image-registry-tls" not found Jul 27 17:01:12.995465 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:12.995422 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:12.996135 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:12.995607 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 27 17:01:12.996135 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:12.995614 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:12.996135 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:12.995676 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls podName:9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e nodeName:}" failed. No retries permitted until 2026-07-27 17:01:20.995657696 +0000 UTC m=+62.244294162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cj8v2" (UID: "9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e") : secret "insights-runtime-extractor-tls" not found Jul 27 17:01:12.996331 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:12.996280 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:13.096940 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:13.096904 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:01:13.097083 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:13.096998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:01:13.097162 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:13.097138 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 27 17:01:13.097212 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:13.097202 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls podName:beafa525-e855-4bb3-8b86-d93611b2f2c1 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:29.097188158 +0000 UTC m=+70.345824623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-f95gb" (UID: "beafa525-e855-4bb3-8b86-d93611b2f2c1") : secret "cluster-monitoring-operator-tls" not found Jul 27 17:01:13.099834 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:13.099805 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9742883-9cdb-4a8f-98bf-cc8fef7f070c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-qljqz\" (UID: \"d9742883-9cdb-4a8f-98bf-cc8fef7f070c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:01:13.197648 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:13.197615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:13.197766 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:13.197661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:13.197831 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:13.197765 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:29.197747457 +0000 UTC m=+70.446383923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : configmap references non-existent config key: service-ca.crt Jul 27 17:01:13.197892 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:13.197857 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 27 17:01:13.197948 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:13.197932 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs podName:55886cbf-490e-45fb-9a50-ba190b8b3f15 nodeName:}" failed. No retries permitted until 2026-07-27 17:01:29.197910868 +0000 UTC m=+70.446547339 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs") pod "router-default-54886598f-4vhvf" (UID: "55886cbf-490e-45fb-9a50-ba190b8b3f15") : secret "router-metrics-certs-default" not found Jul 27 17:01:13.232871 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:13.232847 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" Jul 27 17:01:13.386443 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:13.386415 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz"] Jul 27 17:01:13.530948 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:13.530922 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" event={"ID":"d9742883-9cdb-4a8f-98bf-cc8fef7f070c","Type":"ContainerStarted","Data":"98f0b64721f80d5d08e1d898514c653141bd0d30682d7fcaa1d6c5f2641caeee"} Jul 27 17:01:17.543538 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:17.543480 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" event={"ID":"d9742883-9cdb-4a8f-98bf-cc8fef7f070c","Type":"ContainerStarted","Data":"9eb82847a20665995188b6c9acd0c34b5081da59470debe2f96ed367e8064922"} Jul 27 17:01:17.543920 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:17.543565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" event={"ID":"d9742883-9cdb-4a8f-98bf-cc8fef7f070c","Type":"ContainerStarted","Data":"8e76af5fb3f6925c710c08a3c98eec4a98aa16d447ccadf853e1d0f7d35ee1cb"} Jul 27 17:01:17.565686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:17.565639 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-qljqz" podStartSLOduration=17.10463599 podStartE2EDuration="20.565622253s" totalImagesPullingTime="3.460986263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:17.564473248 +0000 UTC m=+58.813109735" watchObservedRunningTime="2026-07-27 17:01:17.565622253 +0000 UTC m=+58.814258807" Jul 27 17:01:18.431254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:18.431225 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ccmz8" Jul 27 17:01:21.065026 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:21.064996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:21.067278 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:21.067257 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cj8v2\" (UID: \"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e\") " pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:21.171067 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:21.171040 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8tdwq\"" Jul 27 17:01:21.179429 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:21.179413 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cj8v2" Jul 27 17:01:21.314823 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:21.314790 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cj8v2"] Jul 27 17:01:21.317081 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:01:21.317046 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2a5c1e_e06e_4c40_9f2b_90a08927ba0e.slice/crio-9532f1ba69f1e5c81997331a25a8f80427d01d2def9e5d39463fa530fe6bc0e1 WatchSource:0}: Error finding container 9532f1ba69f1e5c81997331a25a8f80427d01d2def9e5d39463fa530fe6bc0e1: Status 404 returned error can't find the container with id 9532f1ba69f1e5c81997331a25a8f80427d01d2def9e5d39463fa530fe6bc0e1 Jul 27 17:01:21.557366 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:21.557331 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cj8v2" event={"ID":"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e","Type":"ContainerStarted","Data":"9532f1ba69f1e5c81997331a25a8f80427d01d2def9e5d39463fa530fe6bc0e1"} Jul 27 17:01:23.242435 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:23.242398 2558 scope.go:117] "RemoveContainer" containerID="8b95c2a943293d6502e2195d07a2a298fd584b5235a87afc728e0d0e2bd62f5e" Jul 27 17:01:23.569703 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:23.569676 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:01:23.570163 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:23.570144 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/1.log" Jul 27 17:01:23.570246 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:23.570188 2558 generic.go:356] "Generic (PLEG): container finished" podID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" containerID="002acb8e2cc3354526a0d6e493c4ce187dd8c77bec454b372a283957914173ee" exitCode=255 Jul 27 17:01:23.570246 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:23.570233 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" event={"ID":"74763785-12fb-4fe1-9f3f-d0d18ff33ecb","Type":"ContainerDied","Data":"002acb8e2cc3354526a0d6e493c4ce187dd8c77bec454b372a283957914173ee"} Jul 27 17:01:23.570325 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:23.570285 2558 scope.go:117] "RemoveContainer" containerID="8b95c2a943293d6502e2195d07a2a298fd584b5235a87afc728e0d0e2bd62f5e" Jul 27 17:01:23.570617 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:23.570591 2558 scope.go:117] "RemoveContainer" containerID="002acb8e2cc3354526a0d6e493c4ce187dd8c77bec454b372a283957914173ee" Jul 27 17:01:23.570837 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:23.570815 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-6xlxh_openshift-console-operator(74763785-12fb-4fe1-9f3f-d0d18ff33ecb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" podUID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" Jul 27 17:01:25.004088 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.004037 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:01:25.004582 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.004171 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:01:25.006827 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.006803 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 27 17:01:25.007923 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.007902 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 27 17:01:25.017719 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.017693 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e726e51d-787e-4b3f-b003-ad105dd69b3e-original-pull-secret\") pod \"global-pull-secret-syncer-m8xpw\" (UID: \"e726e51d-787e-4b3f-b003-ad105dd69b3e\") " pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:01:25.017839 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.017735 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86b8c493-d5fc-44f8-9aba-1a30e8f2a82b-metrics-certs\") pod \"network-metrics-daemon-sv2m2\" (UID: \"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b\") " pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:01:25.162310 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.162278 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m8xpw" Jul 27 17:01:25.170323 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.170299 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z5w7g\"" Jul 27 17:01:25.177954 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.177931 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv2m2" Jul 27 17:01:25.206025 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.205999 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:01:25.208795 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.208773 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 27 17:01:25.218924 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.218901 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 27 17:01:25.229953 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.229928 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbdcb\" (UniqueName: \"kubernetes.io/projected/0cf5db6e-8a9f-4bed-bca3-873abc56cf26-kube-api-access-lbdcb\") pod \"network-check-target-fzxxj\" (UID: \"0cf5db6e-8a9f-4bed-bca3-873abc56cf26\") " pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:01:25.457439 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.457407 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4q746\"" Jul 27 17:01:25.465974 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:25.465945 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:01:26.115383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.115293 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:01:26.115383 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.115379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:01:26.118476 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.118449 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b1a7361-fe70-4825-82c5-28abfce0499a-metrics-tls\") pod \"dns-default-x9v8v\" (UID: \"1b1a7361-fe70-4825-82c5-28abfce0499a\") " pod="openshift-dns/dns-default-x9v8v" Jul 27 17:01:26.118476 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.118472 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"image-registry-7b555ffcb9-v777z\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:01:26.286570 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.286544 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6fpm7\"" Jul 27 17:01:26.294904 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.294805 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:01:26.320651 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.320630 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gsvqh\"" Jul 27 17:01:26.327246 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.327225 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x9v8v" Jul 27 17:01:26.335407 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.335384 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fzxxj"] Jul 27 17:01:26.337863 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:01:26.337838 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf5db6e_8a9f_4bed_bca3_873abc56cf26.slice/crio-faa4691a8cafec6b849d2a92477aa5932ee66b7853016b9dcef0a8ff51898cad WatchSource:0}: Error finding container faa4691a8cafec6b849d2a92477aa5932ee66b7853016b9dcef0a8ff51898cad: Status 404 returned error can't find the container with id faa4691a8cafec6b849d2a92477aa5932ee66b7853016b9dcef0a8ff51898cad Jul 27 17:01:26.454698 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.454633 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b555ffcb9-v777z"] Jul 27 17:01:26.457353 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:01:26.457316 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f29f2a3_be88_4693_9137_4f98ea55dc9c.slice/crio-e2086513ee9d352196980fefea83b50536c2560be1546ed9e3bdaf605fc42216 WatchSource:0}: Error finding container e2086513ee9d352196980fefea83b50536c2560be1546ed9e3bdaf605fc42216: Status 404 returned error can't find the container with id e2086513ee9d352196980fefea83b50536c2560be1546ed9e3bdaf605fc42216 Jul 27 17:01:26.468965 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.468941 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl"] Jul 27 17:01:26.473553 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.473535 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" Jul 27 17:01:26.476256 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.476233 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 27 17:01:26.476369 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.476305 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qq7ts\"" Jul 27 17:01:26.476645 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.476621 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 27 17:01:26.476645 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.476626 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 27 17:01:26.477023 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.476993 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 27 17:01:26.477557 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.477533 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x9v8v"] Jul 27 17:01:26.479289 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:01:26.479262 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1a7361_fe70_4825_82c5_28abfce0499a.slice/crio-3b97100977bf2c30c00db0383c189649a08bb6fef6c8398925d3618658da3232 WatchSource:0}: Error finding container 3b97100977bf2c30c00db0383c189649a08bb6fef6c8398925d3618658da3232: Status 404 returned error can't find the container with id 3b97100977bf2c30c00db0383c189649a08bb6fef6c8398925d3618658da3232 Jul 27 17:01:26.483425 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.483102 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl"] Jul 27 17:01:26.583678 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.583653 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:01:26.584851 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.584819 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9v8v" event={"ID":"1b1a7361-fe70-4825-82c5-28abfce0499a","Type":"ContainerStarted","Data":"3b97100977bf2c30c00db0383c189649a08bb6fef6c8398925d3618658da3232"} Jul 27 17:01:26.586207 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.586183 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cj8v2" event={"ID":"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e","Type":"ContainerStarted","Data":"c3a1b62571d3053a348f4bb204646cbd70a1c3385fc982dd498f3c9e8ea56793"} Jul 27 17:01:26.587560 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.587538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" event={"ID":"9f29f2a3-be88-4693-9137-4f98ea55dc9c","Type":"ContainerStarted","Data":"61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7"} Jul 27 17:01:26.587681 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.587577 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" event={"ID":"9f29f2a3-be88-4693-9137-4f98ea55dc9c","Type":"ContainerStarted","Data":"e2086513ee9d352196980fefea83b50536c2560be1546ed9e3bdaf605fc42216"} Jul 27 17:01:26.587681 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.587606 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:01:26.588554 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.588538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fzxxj" event={"ID":"0cf5db6e-8a9f-4bed-bca3-873abc56cf26","Type":"ContainerStarted","Data":"faa4691a8cafec6b849d2a92477aa5932ee66b7853016b9dcef0a8ff51898cad"} Jul 27 17:01:26.601073 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.601048 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m8xpw"] Jul 27 17:01:26.607007 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:01:26.606985 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode726e51d_787e_4b3f_b003_ad105dd69b3e.slice/crio-be3d6192cfaa569f3e830b0e76b5fccdd3a4fa9f0e58953afcd95e7acb33ad1f WatchSource:0}: Error finding container be3d6192cfaa569f3e830b0e76b5fccdd3a4fa9f0e58953afcd95e7acb33ad1f: Status 404 returned error can't find the container with id be3d6192cfaa569f3e830b0e76b5fccdd3a4fa9f0e58953afcd95e7acb33ad1f Jul 27 17:01:26.616427 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.616407 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sv2m2"] Jul 27 17:01:26.617223 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:01:26.617199 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b8c493_d5fc_44f8_9aba_1a30e8f2a82b.slice/crio-778c546fa3aa5e0295d845d1041072e787aad5359f25448679aac5d4be485bab WatchSource:0}: Error finding container 778c546fa3aa5e0295d845d1041072e787aad5359f25448679aac5d4be485bab: Status 404 returned error can't find the container with id 778c546fa3aa5e0295d845d1041072e787aad5359f25448679aac5d4be485bab Jul 27 17:01:26.624448 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.624425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af176435-c101-453f-a3eb-900c9e8b18ca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-859f9797f4-w84rl\" (UID: \"af176435-c101-453f-a3eb-900c9e8b18ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" Jul 27 17:01:26.624566 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.624474 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfmb\" (UniqueName: \"kubernetes.io/projected/af176435-c101-453f-a3eb-900c9e8b18ca-kube-api-access-4dfmb\") pod \"managed-serviceaccount-addon-agent-859f9797f4-w84rl\" (UID: \"af176435-c101-453f-a3eb-900c9e8b18ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" Jul 27 17:01:26.725873 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.725791 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af176435-c101-453f-a3eb-900c9e8b18ca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-859f9797f4-w84rl\" (UID: \"af176435-c101-453f-a3eb-900c9e8b18ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" Jul 27 17:01:26.725873 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.725869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfmb\" (UniqueName: \"kubernetes.io/projected/af176435-c101-453f-a3eb-900c9e8b18ca-kube-api-access-4dfmb\") pod \"managed-serviceaccount-addon-agent-859f9797f4-w84rl\" (UID: \"af176435-c101-453f-a3eb-900c9e8b18ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" Jul 27 17:01:26.728617 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.728588 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af176435-c101-453f-a3eb-900c9e8b18ca-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-859f9797f4-w84rl\" (UID: \"af176435-c101-453f-a3eb-900c9e8b18ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" Jul 27 17:01:26.762264 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.762236 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfmb\" (UniqueName: \"kubernetes.io/projected/af176435-c101-453f-a3eb-900c9e8b18ca-kube-api-access-4dfmb\") pod \"managed-serviceaccount-addon-agent-859f9797f4-w84rl\" (UID: \"af176435-c101-453f-a3eb-900c9e8b18ca\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" Jul 27 17:01:26.806125 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.806095 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" Jul 27 17:01:26.971396 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.971345 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" podStartSLOduration=45.971322903 podStartE2EDuration="45.971322903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:26.663923299 +0000 UTC m=+67.912559786" watchObservedRunningTime="2026-07-27 17:01:26.971322903 +0000 UTC m=+68.219959392" Jul 27 17:01:26.972237 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:26.972193 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl"] Jul 27 17:01:26.975590 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:01:26.975542 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf176435_c101_453f_a3eb_900c9e8b18ca.slice/crio-8ae7d5f9088ad201e51291c022c2add05142e0c644c5815019c9a8a633552f79 WatchSource:0}: Error finding container 8ae7d5f9088ad201e51291c022c2add05142e0c644c5815019c9a8a633552f79: Status 404 returned error can't find the container with id 8ae7d5f9088ad201e51291c022c2add05142e0c644c5815019c9a8a633552f79 Jul 27 17:01:27.595409 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:27.595328 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m8xpw" event={"ID":"e726e51d-787e-4b3f-b003-ad105dd69b3e","Type":"ContainerStarted","Data":"be3d6192cfaa569f3e830b0e76b5fccdd3a4fa9f0e58953afcd95e7acb33ad1f"} Jul 27 17:01:27.598675 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:27.598613 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" event={"ID":"af176435-c101-453f-a3eb-900c9e8b18ca","Type":"ContainerStarted","Data":"8ae7d5f9088ad201e51291c022c2add05142e0c644c5815019c9a8a633552f79"} Jul 27 17:01:27.602591 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:27.602524 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sv2m2" event={"ID":"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b","Type":"ContainerStarted","Data":"778c546fa3aa5e0295d845d1041072e787aad5359f25448679aac5d4be485bab"} Jul 27 17:01:27.628599 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:27.628085 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:01:27.628599 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:27.628437 2558 scope.go:117] "RemoveContainer" containerID="002acb8e2cc3354526a0d6e493c4ce187dd8c77bec454b372a283957914173ee" Jul 27 17:01:27.628599 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:27.628562 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:01:27.629666 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:27.629246 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-6xlxh_openshift-console-operator(74763785-12fb-4fe1-9f3f-d0d18ff33ecb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" podUID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" Jul 27 17:01:28.607483 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:28.606887 2558 scope.go:117] "RemoveContainer" containerID="002acb8e2cc3354526a0d6e493c4ce187dd8c77bec454b372a283957914173ee" Jul 27 17:01:28.607483 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:28.607084 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-6xlxh_openshift-console-operator(74763785-12fb-4fe1-9f3f-d0d18ff33ecb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" podUID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" Jul 27 17:01:29.150817 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.150138 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:01:29.158034 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.157972 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/beafa525-e855-4bb3-8b86-d93611b2f2c1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-f95gb\" (UID: \"beafa525-e855-4bb3-8b86-d93611b2f2c1\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:01:29.251832 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.251295 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:29.251832 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.251355 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:29.252151 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.252128 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55886cbf-490e-45fb-9a50-ba190b8b3f15-service-ca-bundle\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:29.259568 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.259461 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55886cbf-490e-45fb-9a50-ba190b8b3f15-metrics-certs\") pod \"router-default-54886598f-4vhvf\" (UID: \"55886cbf-490e-45fb-9a50-ba190b8b3f15\") " pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:29.423099 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.423016 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jj2sb\"" Jul 27 17:01:29.430782 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.430737 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" Jul 27 17:01:29.520202 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.520167 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8grpq\"" Jul 27 17:01:29.527474 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:29.527442 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:36.007709 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.007396 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb"] Jul 27 17:01:36.106272 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.106104 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54886598f-4vhvf"] Jul 27 17:01:36.110447 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:01:36.110389 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55886cbf_490e_45fb_9a50_ba190b8b3f15.slice/crio-694c521c43e4923f45a690a85483d225c18bf5d013d288752fde113778beba71 WatchSource:0}: Error finding container 694c521c43e4923f45a690a85483d225c18bf5d013d288752fde113778beba71: Status 404 returned error can't find the container with id 694c521c43e4923f45a690a85483d225c18bf5d013d288752fde113778beba71 Jul 27 17:01:36.640616 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.640568 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cj8v2" event={"ID":"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e","Type":"ContainerStarted","Data":"f56083de2036aad7210ec4c0d134bff527b5dba722f99aaad56f4162a7aff331"} Jul 27 17:01:36.642363 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.642327 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" event={"ID":"af176435-c101-453f-a3eb-900c9e8b18ca","Type":"ContainerStarted","Data":"4abadb366e98d088f2d63377fa66a16af1bef6f51a5be5ac6a697d067dcafb76"} Jul 27 17:01:36.644397 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.644370 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sv2m2" event={"ID":"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b","Type":"ContainerStarted","Data":"187500bb62fc537e9f0c8474ac14f0a627e6884b19ef9decc4d0b23bf1d97c5b"} Jul 27 17:01:36.644552 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.644430 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sv2m2" event={"ID":"86b8c493-d5fc-44f8-9aba-1a30e8f2a82b","Type":"ContainerStarted","Data":"19b1fdf2a4baa0974fcac84faf39e2700cf97689979847f1de08be73abe24072"} Jul 27 17:01:36.645869 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.645843 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" event={"ID":"beafa525-e855-4bb3-8b86-d93611b2f2c1","Type":"ContainerStarted","Data":"c2624f844f5a0cf7194eec419b3aafbf8dd0e6ffb559da51c397130b5b14641a"} Jul 27 17:01:36.647545 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.647482 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fzxxj" event={"ID":"0cf5db6e-8a9f-4bed-bca3-873abc56cf26","Type":"ContainerStarted","Data":"0562e24ec92504b40eff51afbe2ee6870d5038314707d190098ed0954506c4b0"} Jul 27 17:01:36.647682 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.647629 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:01:36.649315 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.649285 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m8xpw" event={"ID":"e726e51d-787e-4b3f-b003-ad105dd69b3e","Type":"ContainerStarted","Data":"2d39c1cd722edbaf91cbfb0fbf68e07f885644736ef24c309c825bc930459fa9"} Jul 27 17:01:36.651421 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.651364 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9v8v" event={"ID":"1b1a7361-fe70-4825-82c5-28abfce0499a","Type":"ContainerStarted","Data":"2cebedd63e6b908ff68ecdcbc01756a92a90d7cadf9c62c2118367dc3543a802"} Jul 27 17:01:36.651585 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.651439 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x9v8v" event={"ID":"1b1a7361-fe70-4825-82c5-28abfce0499a","Type":"ContainerStarted","Data":"3b80a2230bf8ff268ef8364a9942c2f067c8d9f316e7c125877ec8c7441829cb"} Jul 27 17:01:36.651585 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.651490 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x9v8v" Jul 27 17:01:36.653187 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.653157 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54886598f-4vhvf" event={"ID":"55886cbf-490e-45fb-9a50-ba190b8b3f15","Type":"ContainerStarted","Data":"173cf86b65bc18337b89fc35c54f5f61c8c26dca40971f8a0e8d2c70cfbcf580"} Jul 27 17:01:36.653329 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.653224 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54886598f-4vhvf" event={"ID":"55886cbf-490e-45fb-9a50-ba190b8b3f15","Type":"ContainerStarted","Data":"694c521c43e4923f45a690a85483d225c18bf5d013d288752fde113778beba71"} Jul 27 17:01:36.663486 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.663424 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-859f9797f4-w84rl" podStartSLOduration=1.70026337 podStartE2EDuration="10.663399882s" totalImagesPullingTime="8.963136512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:36.661413113 +0000 UTC m=+77.910049602" watchObservedRunningTime="2026-07-27 17:01:36.663399882 +0000 UTC m=+77.912036367" Jul 27 17:01:36.683039 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.682985 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m8xpw" podStartSLOduration=67.431766634 podStartE2EDuration="1m16.682969318s" totalImagesPullingTime="9.251202684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:36.682138931 +0000 UTC m=+77.930775419" watchObservedRunningTime="2026-07-27 17:01:36.682969318 +0000 UTC m=+77.931605861" Jul 27 17:01:36.706092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.706033 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54886598f-4vhvf" podStartSLOduration=39.706016237 podStartE2EDuration="39.706016237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:36.703571348 +0000 UTC m=+77.952207834" watchObservedRunningTime="2026-07-27 17:01:36.706016237 +0000 UTC m=+77.954652743" Jul 27 17:01:36.735125 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.735056 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fzxxj" podStartSLOduration=67.136389383 podStartE2EDuration="1m16.735039953s" totalImagesPullingTime="9.59865057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:36.734914939 +0000 UTC m=+77.983551427" watchObservedRunningTime="2026-07-27 17:01:36.735039953 +0000 UTC m=+77.983676440" Jul 27 17:01:36.757778 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.757713 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sv2m2" podStartSLOduration=68.439721091 podStartE2EDuration="1m17.757695663s" totalImagesPullingTime="9.317974572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:36.757323051 +0000 UTC m=+78.005959538" watchObservedRunningTime="2026-07-27 17:01:36.757695663 +0000 UTC m=+78.006332150" Jul 27 17:01:36.777392 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:36.777338 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x9v8v" podStartSLOduration=40.387823843 podStartE2EDuration="42.777320076s" totalImagesPullingTime="2.389496233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:36.775844118 +0000 UTC m=+78.024480605" watchObservedRunningTime="2026-07-27 17:01:36.777320076 +0000 UTC m=+78.025956573" Jul 27 17:01:37.528038 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:37.527990 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:37.530783 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:37.530760 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:37.659622 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:37.659550 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:37.660423 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:37.660397 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54886598f-4vhvf" Jul 27 17:01:39.249169 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:39.249139 2558 scope.go:117] "RemoveContainer" containerID="002acb8e2cc3354526a0d6e493c4ce187dd8c77bec454b372a283957914173ee" Jul 27 17:01:39.249817 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:01:39.249339 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-6xlxh_openshift-console-operator(74763785-12fb-4fe1-9f3f-d0d18ff33ecb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" podUID="74763785-12fb-4fe1-9f3f-d0d18ff33ecb" Jul 27 17:01:40.674170 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:40.674023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cj8v2" event={"ID":"9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e","Type":"ContainerStarted","Data":"0cd6608a21ca53e66ef637e1393ab66276101e46a6988ab687a178ed436e1ea0"} Jul 27 17:01:40.676008 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:40.675979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" event={"ID":"beafa525-e855-4bb3-8b86-d93611b2f2c1","Type":"ContainerStarted","Data":"bb5c68addbc6aab7d8f0f48722c75403fa187d1aa464da7012ec51f02b2d7fb6"} Jul 27 17:01:40.695561 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:40.695477 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cj8v2" podStartSLOduration=17.362312439 podStartE2EDuration="35.695459217s" totalImagesPullingTime="18.333146778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:40.694453491 +0000 UTC m=+81.943089992" watchObservedRunningTime="2026-07-27 17:01:40.695459217 +0000 UTC m=+81.944095705" Jul 27 17:01:40.711031 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:40.710975 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-f95gb" podStartSLOduration=39.730563934 podStartE2EDuration="43.710957955s" totalImagesPullingTime="3.980394021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:40.710445409 +0000 UTC m=+81.959081897" watchObservedRunningTime="2026-07-27 17:01:40.710957955 +0000 UTC m=+81.959594442" Jul 27 17:01:46.299757 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:46.299705 2558 patch_prober.go:28] interesting pod/image-registry-7b555ffcb9-v777z container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 27 17:01:46.300158 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:46.299773 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" podUID="9f29f2a3-be88-4693-9137-4f98ea55dc9c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 17:01:46.661610 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:46.661521 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x9v8v" Jul 27 17:01:47.606922 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:47.606895 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:01:48.327954 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:48.327914 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b555ffcb9-v777z"] Jul 27 17:01:52.242634 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:52.242598 2558 scope.go:117] "RemoveContainer" containerID="002acb8e2cc3354526a0d6e493c4ce187dd8c77bec454b372a283957914173ee" Jul 27 17:01:52.721325 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:52.721291 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:01:52.721575 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:52.721387 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" event={"ID":"74763785-12fb-4fe1-9f3f-d0d18ff33ecb","Type":"ContainerStarted","Data":"049f304c053b1455cecde0f3a6db70ee1382300773c38eb065f4038fadb3e3c7"} Jul 27 17:01:52.721988 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:52.721933 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:01:52.728608 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:52.728547 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" Jul 27 17:01:52.745462 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:52.745392 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-6xlxh" podStartSLOduration=49.676436707 podStartE2EDuration="55.745370825s" totalImagesPullingTime="6.068934118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:52.743757506 +0000 UTC m=+93.992393976" watchObservedRunningTime="2026-07-27 17:01:52.745370825 +0000 UTC m=+93.994007313" Jul 27 17:01:53.118725 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.118687 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7dglc"] Jul 27 17:01:53.122777 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.122756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.125877 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.125854 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 27 17:01:53.126011 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.125921 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 27 17:01:53.126183 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.126168 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 27 17:01:53.127011 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.126994 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jrc75\"" Jul 27 17:01:53.127195 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.127178 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 27 17:01:53.145484 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.145451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-root\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.145663 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.145494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-textfile\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.145663 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.145540 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-tls\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.145663 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.145589 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.145663 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.145625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-metrics-client-ca\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.145663 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.145661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-wtmp\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.145824 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.145690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-sys\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.145824 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.145756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.145824 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.145777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7qgw\" (UniqueName: \"kubernetes.io/projected/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-kube-api-access-q7qgw\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.246533 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246487 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-textfile\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.246533 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-tls\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246580 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-metrics-client-ca\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246687 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-wtmp\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-sys\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246798 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7qgw\" (UniqueName: \"kubernetes.io/projected/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-kube-api-access-q7qgw\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246841 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-textfile\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246859 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-sys\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-root\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.246907 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-wtmp\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247092 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.247034 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-root\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247567 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.247241 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-metrics-client-ca\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.247567 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.247236 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.249297 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.249264 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.249458 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.249438 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-node-exporter-tls\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.258273 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.258247 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7qgw\" (UniqueName: \"kubernetes.io/projected/7c31d39a-acec-4afd-85f2-9d6f082a9a2d-kube-api-access-q7qgw\") pod \"node-exporter-7dglc\" (UID: \"7c31d39a-acec-4afd-85f2-9d6f082a9a2d\") " pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.432742 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.432646 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7dglc" Jul 27 17:01:53.446981 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:01:53.446937 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c31d39a_acec_4afd_85f2_9d6f082a9a2d.slice/crio-910dbe6ea3a84c088e682997b0e4e5ebe579f3fd9f5d6a781c9d3aaf4a991941 WatchSource:0}: Error finding container 910dbe6ea3a84c088e682997b0e4e5ebe579f3fd9f5d6a781c9d3aaf4a991941: Status 404 returned error can't find the container with id 910dbe6ea3a84c088e682997b0e4e5ebe579f3fd9f5d6a781c9d3aaf4a991941 Jul 27 17:01:53.726776 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:53.726657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dglc" event={"ID":"7c31d39a-acec-4afd-85f2-9d6f082a9a2d","Type":"ContainerStarted","Data":"910dbe6ea3a84c088e682997b0e4e5ebe579f3fd9f5d6a781c9d3aaf4a991941"} Jul 27 17:01:56.740013 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:56.739927 2558 generic.go:356] "Generic (PLEG): container finished" podID="7c31d39a-acec-4afd-85f2-9d6f082a9a2d" containerID="c9f66d5f230f54855de709cce6787007f92fe00d582e3f944b6584708a7629f3" exitCode=0 Jul 27 17:01:56.740013 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:56.739996 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dglc" event={"ID":"7c31d39a-acec-4afd-85f2-9d6f082a9a2d","Type":"ContainerDied","Data":"c9f66d5f230f54855de709cce6787007f92fe00d582e3f944b6584708a7629f3"} Jul 27 17:01:57.745850 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:57.745813 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dglc" event={"ID":"7c31d39a-acec-4afd-85f2-9d6f082a9a2d","Type":"ContainerStarted","Data":"f3da6e7ab337c27937499e4e44f05816bf330cc1bd2492029ec987d5ed412112"} Jul 27 17:01:57.746298 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:57.745877 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dglc" event={"ID":"7c31d39a-acec-4afd-85f2-9d6f082a9a2d","Type":"ContainerStarted","Data":"4cce3953cc704f96c247658aa0b4f164376f635f6603e099c3c05d2833cba597"} Jul 27 17:01:57.769091 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:01:57.769036 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7dglc" podStartSLOduration=1.994070147 podStartE2EDuration="4.769016669s" totalImagesPullingTime="2.662323439s" totalInitContainerRuntime="112.623083ms" isStatefulPod=true podCreationTimestamp="2026-07-27 17:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:01:57.767101824 +0000 UTC m=+99.015738310" watchObservedRunningTime="2026-07-27 17:01:57.769016669 +0000 UTC m=+99.017653156" Jul 27 17:02:00.812709 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.812665 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-559c77f795-6zkkv"] Jul 27 17:02:00.817074 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.817048 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:00.820826 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.820801 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ck8h9\"" Jul 27 17:02:00.821004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.820843 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 27 17:02:00.821004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.820805 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 27 17:02:00.821004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.820876 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 27 17:02:00.821004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.820891 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 27 17:02:00.821004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.820929 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 27 17:02:00.821004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.820801 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 27 17:02:00.821250 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.821068 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 27 17:02:00.823724 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.823670 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559c77f795-6zkkv"] Jul 27 17:02:00.912177 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.912145 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-oauth-serving-cert\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:00.912177 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.912187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5pjb\" (UniqueName: \"kubernetes.io/projected/d2660196-56e0-4b53-8632-d1dc0e932395-kube-api-access-j5pjb\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:00.912458 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.912223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-oauth-config\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:00.912458 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.912247 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-console-config\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:00.912458 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.912297 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-service-ca\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:00.912458 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:00.912382 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-serving-cert\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.013497 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.013457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5pjb\" (UniqueName: \"kubernetes.io/projected/d2660196-56e0-4b53-8632-d1dc0e932395-kube-api-access-j5pjb\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.013743 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.013561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-oauth-config\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.013743 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.013594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-console-config\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.013743 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.013623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-service-ca\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.013743 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.013667 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-serving-cert\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.013743 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.013702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-oauth-serving-cert\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.014456 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.014412 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-console-config\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.014456 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.014422 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-service-ca\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.014627 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.014469 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-oauth-serving-cert\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.016130 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.016105 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-oauth-config\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.016224 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.016212 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-serving-cert\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.023661 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.023640 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5pjb\" (UniqueName: \"kubernetes.io/projected/d2660196-56e0-4b53-8632-d1dc0e932395-kube-api-access-j5pjb\") pod \"console-559c77f795-6zkkv\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.128316 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.128223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:01.269021 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.268985 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559c77f795-6zkkv"] Jul 27 17:02:01.271845 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:02:01.271812 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2660196_56e0_4b53_8632_d1dc0e932395.slice/crio-3dfdac46a12c7d89794cdda00ad716a5f59dedc69c7a92797bc466034611500b WatchSource:0}: Error finding container 3dfdac46a12c7d89794cdda00ad716a5f59dedc69c7a92797bc466034611500b: Status 404 returned error can't find the container with id 3dfdac46a12c7d89794cdda00ad716a5f59dedc69c7a92797bc466034611500b Jul 27 17:02:01.761421 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:01.761388 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559c77f795-6zkkv" event={"ID":"d2660196-56e0-4b53-8632-d1dc0e932395","Type":"ContainerStarted","Data":"3dfdac46a12c7d89794cdda00ad716a5f59dedc69c7a92797bc466034611500b"} Jul 27 17:02:05.779811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:05.779765 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559c77f795-6zkkv" event={"ID":"d2660196-56e0-4b53-8632-d1dc0e932395","Type":"ContainerStarted","Data":"639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95"} Jul 27 17:02:05.799809 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:05.799740 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-559c77f795-6zkkv" podStartSLOduration=1.661616588 podStartE2EDuration="5.7997221s" totalImagesPullingTime="4.138105512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:05.798590409 +0000 UTC m=+107.047226896" watchObservedRunningTime="2026-07-27 17:02:05.7997221 +0000 UTC m=+107.048358587" Jul 27 17:02:07.662248 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:07.662220 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fzxxj" Jul 27 17:02:08.347454 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.347413 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86bbfc8fdd-26hvb"] Jul 27 17:02:08.393187 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.393156 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bbfc8fdd-26hvb"] Jul 27 17:02:08.393346 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.393255 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.404212 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.404183 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 27 17:02:08.478785 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.478746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-trusted-ca-bundle\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.478785 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.478790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-serving-cert\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.479003 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.478809 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-service-ca\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.479003 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.478902 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-oauth-serving-cert\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.479003 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.478939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxrxw\" (UniqueName: \"kubernetes.io/projected/1503e114-5b6f-42e2-a138-62cb5f2d9681-kube-api-access-kxrxw\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.479003 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.478971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-oauth-config\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.479128 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.479038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-config\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.579547 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.579476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-oauth-serving-cert\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.579547 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.579548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxrxw\" (UniqueName: \"kubernetes.io/projected/1503e114-5b6f-42e2-a138-62cb5f2d9681-kube-api-access-kxrxw\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.579810 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.579573 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-oauth-config\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.579810 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.579607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-config\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.579810 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.579624 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-trusted-ca-bundle\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.579810 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.579643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-serving-cert\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.579810 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.579664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-service-ca\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.580428 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.580398 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-oauth-serving-cert\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.580573 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.580398 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-config\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.580573 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.580472 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-service-ca\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.580662 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.580588 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-trusted-ca-bundle\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.582402 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.582379 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-serving-cert\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.582522 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.582382 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-oauth-config\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.592841 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.592812 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxrxw\" (UniqueName: \"kubernetes.io/projected/1503e114-5b6f-42e2-a138-62cb5f2d9681-kube-api-access-kxrxw\") pod \"console-86bbfc8fdd-26hvb\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.702727 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.702634 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:08.908694 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:08.908654 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bbfc8fdd-26hvb"] Jul 27 17:02:08.911191 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:02:08.911159 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1503e114_5b6f_42e2_a138_62cb5f2d9681.slice/crio-8457443e6a2be1f5ec9f393ce41780ed0ce0198df5dc04b9aa33eacff83a8e2b WatchSource:0}: Error finding container 8457443e6a2be1f5ec9f393ce41780ed0ce0198df5dc04b9aa33eacff83a8e2b: Status 404 returned error can't find the container with id 8457443e6a2be1f5ec9f393ce41780ed0ce0198df5dc04b9aa33eacff83a8e2b Jul 27 17:02:09.797841 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:09.797799 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bbfc8fdd-26hvb" event={"ID":"1503e114-5b6f-42e2-a138-62cb5f2d9681","Type":"ContainerStarted","Data":"474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1"} Jul 27 17:02:09.798240 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:09.797859 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bbfc8fdd-26hvb" event={"ID":"1503e114-5b6f-42e2-a138-62cb5f2d9681","Type":"ContainerStarted","Data":"8457443e6a2be1f5ec9f393ce41780ed0ce0198df5dc04b9aa33eacff83a8e2b"} Jul 27 17:02:09.820299 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:09.820242 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86bbfc8fdd-26hvb" podStartSLOduration=1.820224209 podStartE2EDuration="1.820224209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:02:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:02:09.818789707 +0000 UTC m=+111.067426194" watchObservedRunningTime="2026-07-27 17:02:09.820224209 +0000 UTC m=+111.068860767" Jul 27 17:02:11.129393 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:11.129337 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:11.129846 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:11.129419 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:11.134652 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:11.134625 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:11.810168 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:11.810137 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:13.347967 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.347899 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" podUID="9f29f2a3-be88-4693-9137-4f98ea55dc9c" containerName="registry" containerID="cri-o://61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7" gracePeriod=30 Jul 27 17:02:13.607554 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.607440 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:02:13.729093 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.729055 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f29f2a3-be88-4693-9137-4f98ea55dc9c-ca-trust-extracted\") pod \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " Jul 27 17:02:13.729093 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.729100 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-image-registry-private-configuration\") pod \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " Jul 27 17:02:13.729354 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.729153 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-trusted-ca\") pod \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " Jul 27 17:02:13.729354 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.729192 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-installation-pull-secrets\") pod \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " Jul 27 17:02:13.729354 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.729306 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") pod \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " Jul 27 17:02:13.729529 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.729360 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkqs9\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-kube-api-access-rkqs9\") pod \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " Jul 27 17:02:13.729529 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.729396 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-bound-sa-token\") pod \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " Jul 27 17:02:13.729529 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.729428 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-certificates\") pod \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\" (UID: \"9f29f2a3-be88-4693-9137-4f98ea55dc9c\") " Jul 27 17:02:13.730271 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.730002 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9f29f2a3-be88-4693-9137-4f98ea55dc9c" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:02:13.730271 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.730231 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-trusted-ca\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:13.730554 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.730450 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9f29f2a3-be88-4693-9137-4f98ea55dc9c" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:02:13.732215 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.732191 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9f29f2a3-be88-4693-9137-4f98ea55dc9c" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:02:13.732327 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.732283 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9f29f2a3-be88-4693-9137-4f98ea55dc9c" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:02:13.732327 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.732305 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-kube-api-access-rkqs9" (OuterVolumeSpecName: "kube-api-access-rkqs9") pod "9f29f2a3-be88-4693-9137-4f98ea55dc9c" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c"). InnerVolumeSpecName "kube-api-access-rkqs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:02:13.732419 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.732339 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9f29f2a3-be88-4693-9137-4f98ea55dc9c" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:02:13.732994 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.732977 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9f29f2a3-be88-4693-9137-4f98ea55dc9c" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:02:13.740610 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.740581 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f29f2a3-be88-4693-9137-4f98ea55dc9c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9f29f2a3-be88-4693-9137-4f98ea55dc9c" (UID: "9f29f2a3-be88-4693-9137-4f98ea55dc9c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 17:02:13.815585 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.815550 2558 generic.go:356] "Generic (PLEG): container finished" podID="9f29f2a3-be88-4693-9137-4f98ea55dc9c" containerID="61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7" exitCode=0 Jul 27 17:02:13.815781 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.815599 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" event={"ID":"9f29f2a3-be88-4693-9137-4f98ea55dc9c","Type":"ContainerDied","Data":"61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7"} Jul 27 17:02:13.815781 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.815638 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" event={"ID":"9f29f2a3-be88-4693-9137-4f98ea55dc9c","Type":"ContainerDied","Data":"e2086513ee9d352196980fefea83b50536c2560be1546ed9e3bdaf605fc42216"} Jul 27 17:02:13.815781 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.815659 2558 scope.go:117] "RemoveContainer" containerID="61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7" Jul 27 17:02:13.815781 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.815600 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b555ffcb9-v777z" Jul 27 17:02:13.824627 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.824601 2558 scope.go:117] "RemoveContainer" containerID="61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7" Jul 27 17:02:13.824958 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:02:13.824937 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7\": container with ID starting with 61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7 not found: ID does not exist" containerID="61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7" Jul 27 17:02:13.825041 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.824969 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7"} err="failed to get container status \"61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7\": rpc error: code = NotFound desc = could not find container \"61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7\": container with ID starting with 61b755147ee9286079bef4b0ac145db63c3f634b52d6c203dbfaeacbbacad7e7 not found: ID does not exist" Jul 27 17:02:13.830586 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.830560 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-installation-pull-secrets\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:13.830586 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.830585 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-tls\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:13.830728 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.830593 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkqs9\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-kube-api-access-rkqs9\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:13.830728 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.830602 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f29f2a3-be88-4693-9137-4f98ea55dc9c-bound-sa-token\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:13.830728 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.830610 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f29f2a3-be88-4693-9137-4f98ea55dc9c-registry-certificates\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:13.830728 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.830618 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f29f2a3-be88-4693-9137-4f98ea55dc9c-ca-trust-extracted\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:13.830728 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.830629 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f29f2a3-be88-4693-9137-4f98ea55dc9c-image-registry-private-configuration\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:13.837843 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.837816 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b555ffcb9-v777z"] Jul 27 17:02:13.842813 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:13.842788 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b555ffcb9-v777z"] Jul 27 17:02:15.247344 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:15.247311 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f29f2a3-be88-4693-9137-4f98ea55dc9c" path="/var/lib/kubelet/pods/9f29f2a3-be88-4693-9137-4f98ea55dc9c/volumes" Jul 27 17:02:18.703767 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:18.703723 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:18.704204 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:18.703799 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:18.708942 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:18.708919 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:18.840145 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:18.840113 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:02:18.889955 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:18.889916 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559c77f795-6zkkv"] Jul 27 17:02:19.841137 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:19.841099 2558 generic.go:356] "Generic (PLEG): container finished" podID="100ca857-21a7-405d-8a84-4ecdda1e8655" containerID="f8d71cca2a04329f0d75752155e41aed9ed96ce15c06c484de79711e3ccd5f20" exitCode=0 Jul 27 17:02:19.841537 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:19.841168 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" event={"ID":"100ca857-21a7-405d-8a84-4ecdda1e8655","Type":"ContainerDied","Data":"f8d71cca2a04329f0d75752155e41aed9ed96ce15c06c484de79711e3ccd5f20"} Jul 27 17:02:19.841657 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:19.841642 2558 scope.go:117] "RemoveContainer" containerID="f8d71cca2a04329f0d75752155e41aed9ed96ce15c06c484de79711e3ccd5f20" Jul 27 17:02:20.846921 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:20.846886 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bzhbm" event={"ID":"100ca857-21a7-405d-8a84-4ecdda1e8655","Type":"ContainerStarted","Data":"20659c145a01df2f7824fbfe0d190b53aa8953f9571c6b0063f42072c332474d"} Jul 27 17:02:29.880738 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:29.880702 2558 generic.go:356] "Generic (PLEG): container finished" podID="592d9913-e610-4245-9cea-5d505993746e" containerID="e8bdee1e4d3c644d726ada562c728f80640bdcdaba1989aacf968f83abac5b55" exitCode=0 Jul 27 17:02:29.881102 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:29.880777 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" event={"ID":"592d9913-e610-4245-9cea-5d505993746e","Type":"ContainerDied","Data":"e8bdee1e4d3c644d726ada562c728f80640bdcdaba1989aacf968f83abac5b55"} Jul 27 17:02:29.881144 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:29.881106 2558 scope.go:117] "RemoveContainer" containerID="e8bdee1e4d3c644d726ada562c728f80640bdcdaba1989aacf968f83abac5b55" Jul 27 17:02:30.886542 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:30.886481 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj" event={"ID":"592d9913-e610-4245-9cea-5d505993746e","Type":"ContainerStarted","Data":"d47876149f1eb4cb3a0ec463072f2eff786c80a6c57d50aa804f6b2fa380f6c8"} Jul 27 17:02:35.906229 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:35.906190 2558 generic.go:356] "Generic (PLEG): container finished" podID="ffa39d2c-ea50-4534-849f-c7a48af88694" containerID="d1ac119f7b6221ad9eac345eca0a4b7a1a9ab5a25f47726df4d267c2942f7d27" exitCode=0 Jul 27 17:02:35.906622 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:35.906248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hbw96" event={"ID":"ffa39d2c-ea50-4534-849f-c7a48af88694","Type":"ContainerDied","Data":"d1ac119f7b6221ad9eac345eca0a4b7a1a9ab5a25f47726df4d267c2942f7d27"} Jul 27 17:02:35.906622 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:35.906564 2558 scope.go:117] "RemoveContainer" containerID="d1ac119f7b6221ad9eac345eca0a4b7a1a9ab5a25f47726df4d267c2942f7d27" Jul 27 17:02:36.912175 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:36.912140 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-hbw96" event={"ID":"ffa39d2c-ea50-4534-849f-c7a48af88694","Type":"ContainerStarted","Data":"14555e504c962df76c45022acb5e2af8929a0870146fc2ff60ae74d9943d6188"} Jul 27 17:02:43.912976 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:43.912935 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-559c77f795-6zkkv" podUID="d2660196-56e0-4b53-8632-d1dc0e932395" containerName="console" containerID="cri-o://639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95" gracePeriod=15 Jul 27 17:02:44.163077 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.163021 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:44.267954 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.267926 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-oauth-config\") pod \"d2660196-56e0-4b53-8632-d1dc0e932395\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " Jul 27 17:02:44.268071 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.267968 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-oauth-serving-cert\") pod \"d2660196-56e0-4b53-8632-d1dc0e932395\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " Jul 27 17:02:44.268071 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.268000 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-serving-cert\") pod \"d2660196-56e0-4b53-8632-d1dc0e932395\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " Jul 27 17:02:44.268154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.268110 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5pjb\" (UniqueName: \"kubernetes.io/projected/d2660196-56e0-4b53-8632-d1dc0e932395-kube-api-access-j5pjb\") pod \"d2660196-56e0-4b53-8632-d1dc0e932395\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " Jul 27 17:02:44.268154 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.268148 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-console-config\") pod \"d2660196-56e0-4b53-8632-d1dc0e932395\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " Jul 27 17:02:44.268252 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.268189 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-service-ca\") pod \"d2660196-56e0-4b53-8632-d1dc0e932395\" (UID: \"d2660196-56e0-4b53-8632-d1dc0e932395\") " Jul 27 17:02:44.268467 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.268437 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2660196-56e0-4b53-8632-d1dc0e932395" (UID: "d2660196-56e0-4b53-8632-d1dc0e932395"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:02:44.268608 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.268573 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-console-config" (OuterVolumeSpecName: "console-config") pod "d2660196-56e0-4b53-8632-d1dc0e932395" (UID: "d2660196-56e0-4b53-8632-d1dc0e932395"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:02:44.268686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.268657 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2660196-56e0-4b53-8632-d1dc0e932395" (UID: "d2660196-56e0-4b53-8632-d1dc0e932395"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:02:44.270248 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.270228 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2660196-56e0-4b53-8632-d1dc0e932395" (UID: "d2660196-56e0-4b53-8632-d1dc0e932395"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:02:44.270371 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.270352 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2660196-56e0-4b53-8632-d1dc0e932395" (UID: "d2660196-56e0-4b53-8632-d1dc0e932395"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:02:44.270424 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.270363 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2660196-56e0-4b53-8632-d1dc0e932395-kube-api-access-j5pjb" (OuterVolumeSpecName: "kube-api-access-j5pjb") pod "d2660196-56e0-4b53-8632-d1dc0e932395" (UID: "d2660196-56e0-4b53-8632-d1dc0e932395"). InnerVolumeSpecName "kube-api-access-j5pjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:02:44.369663 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.369642 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-oauth-config\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:44.369663 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.369661 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-oauth-serving-cert\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:44.369785 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.369671 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2660196-56e0-4b53-8632-d1dc0e932395-console-serving-cert\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:44.369785 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.369679 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5pjb\" (UniqueName: \"kubernetes.io/projected/d2660196-56e0-4b53-8632-d1dc0e932395-kube-api-access-j5pjb\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:44.369785 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.369689 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-console-config\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:44.369785 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.369697 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2660196-56e0-4b53-8632-d1dc0e932395-service-ca\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:02:44.942563 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.942531 2558 generic.go:356] "Generic (PLEG): container finished" podID="d2660196-56e0-4b53-8632-d1dc0e932395" containerID="639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95" exitCode=0 Jul 27 17:02:44.942899 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.942583 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559c77f795-6zkkv" Jul 27 17:02:44.942899 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.942614 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559c77f795-6zkkv" event={"ID":"d2660196-56e0-4b53-8632-d1dc0e932395","Type":"ContainerDied","Data":"639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95"} Jul 27 17:02:44.942899 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.942655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559c77f795-6zkkv" event={"ID":"d2660196-56e0-4b53-8632-d1dc0e932395","Type":"ContainerDied","Data":"3dfdac46a12c7d89794cdda00ad716a5f59dedc69c7a92797bc466034611500b"} Jul 27 17:02:44.942899 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.942679 2558 scope.go:117] "RemoveContainer" containerID="639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95" Jul 27 17:02:44.950873 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.950858 2558 scope.go:117] "RemoveContainer" containerID="639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95" Jul 27 17:02:44.951122 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:02:44.951105 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95\": container with ID starting with 639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95 not found: ID does not exist" containerID="639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95" Jul 27 17:02:44.951166 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.951130 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95"} err="failed to get container status \"639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95\": rpc error: code = NotFound desc = could not find container \"639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95\": container with ID starting with 639b9c7e05960ba0fb2f44abd9a9bad4ed5ed95c51930ae4752bd010217a2a95 not found: ID does not exist" Jul 27 17:02:44.962730 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.962707 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559c77f795-6zkkv"] Jul 27 17:02:44.964693 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:44.964673 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-559c77f795-6zkkv"] Jul 27 17:02:45.246982 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:02:45.246917 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2660196-56e0-4b53-8632-d1dc0e932395" path="/var/lib/kubelet/pods/d2660196-56e0-4b53-8632-d1dc0e932395/volumes" Jul 27 17:03:33.264922 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.264881 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-697649c4d8-d9q8x"] Jul 27 17:03:33.265866 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.265833 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f29f2a3-be88-4693-9137-4f98ea55dc9c" containerName="registry" Jul 27 17:03:33.265866 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.265868 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f29f2a3-be88-4693-9137-4f98ea55dc9c" containerName="registry" Jul 27 17:03:33.266119 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.265905 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2660196-56e0-4b53-8632-d1dc0e932395" containerName="console" Jul 27 17:03:33.266119 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.265917 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2660196-56e0-4b53-8632-d1dc0e932395" containerName="console" Jul 27 17:03:33.266119 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.265989 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f29f2a3-be88-4693-9137-4f98ea55dc9c" containerName="registry" Jul 27 17:03:33.266119 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.266002 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2660196-56e0-4b53-8632-d1dc0e932395" containerName="console" Jul 27 17:03:33.270535 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.270487 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.281355 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.281147 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697649c4d8-d9q8x"] Jul 27 17:03:33.364787 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.364749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-console-config\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.364787 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.364785 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w4px\" (UniqueName: \"kubernetes.io/projected/e563feeb-864b-455c-8bde-969be3194d8c-kube-api-access-2w4px\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.365061 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.364836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-oauth-serving-cert\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.365061 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.364874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-oauth-config\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.365167 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.365070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-serving-cert\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.365167 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.365088 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-trusted-ca-bundle\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.365167 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.365104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-service-ca\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.466101 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.466056 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-oauth-config\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.466324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.466119 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-serving-cert\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.466324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.466149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-trusted-ca-bundle\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.466324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.466173 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-service-ca\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.466324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.466224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-console-config\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.466324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.466244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w4px\" (UniqueName: \"kubernetes.io/projected/e563feeb-864b-455c-8bde-969be3194d8c-kube-api-access-2w4px\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.466324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.466277 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-oauth-serving-cert\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.467064 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.467037 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-service-ca\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.467163 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.467067 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-oauth-serving-cert\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.467263 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.467238 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-console-config\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.467730 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.467709 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-trusted-ca-bundle\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.468922 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.468901 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-oauth-config\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.469020 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.469003 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-serving-cert\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.475920 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.475897 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w4px\" (UniqueName: \"kubernetes.io/projected/e563feeb-864b-455c-8bde-969be3194d8c-kube-api-access-2w4px\") pod \"console-697649c4d8-d9q8x\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.581300 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.581210 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:33.728099 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:33.727922 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-697649c4d8-d9q8x"] Jul 27 17:03:33.730388 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:03:33.730353 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode563feeb_864b_455c_8bde_969be3194d8c.slice/crio-258fb827aa088e78d823ec5160b5080ed3e57b1552236a35c33082b291eebed7 WatchSource:0}: Error finding container 258fb827aa088e78d823ec5160b5080ed3e57b1552236a35c33082b291eebed7: Status 404 returned error can't find the container with id 258fb827aa088e78d823ec5160b5080ed3e57b1552236a35c33082b291eebed7 Jul 27 17:03:34.127604 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:34.127557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697649c4d8-d9q8x" event={"ID":"e563feeb-864b-455c-8bde-969be3194d8c","Type":"ContainerStarted","Data":"7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a"} Jul 27 17:03:34.127829 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:34.127646 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697649c4d8-d9q8x" event={"ID":"e563feeb-864b-455c-8bde-969be3194d8c","Type":"ContainerStarted","Data":"258fb827aa088e78d823ec5160b5080ed3e57b1552236a35c33082b291eebed7"} Jul 27 17:03:34.147105 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:34.147044 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-697649c4d8-d9q8x" podStartSLOduration=1.147027098 podStartE2EDuration="1.147027098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:03:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:03:34.146045825 +0000 UTC m=+195.394682314" watchObservedRunningTime="2026-07-27 17:03:34.147027098 +0000 UTC m=+195.395663658" Jul 27 17:03:43.581654 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:43.581604 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:43.582116 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:43.581750 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:43.586589 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:43.586567 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:44.169523 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:44.169478 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:03:44.216080 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:03:44.216040 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bbfc8fdd-26hvb"] Jul 27 17:04:09.242018 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.241971 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86bbfc8fdd-26hvb" podUID="1503e114-5b6f-42e2-a138-62cb5f2d9681" containerName="console" containerID="cri-o://474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1" gracePeriod=15 Jul 27 17:04:09.509142 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.509105 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:04:09.623679 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.623638 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-oauth-serving-cert\") pod \"1503e114-5b6f-42e2-a138-62cb5f2d9681\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " Jul 27 17:04:09.623679 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.623675 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxrxw\" (UniqueName: \"kubernetes.io/projected/1503e114-5b6f-42e2-a138-62cb5f2d9681-kube-api-access-kxrxw\") pod \"1503e114-5b6f-42e2-a138-62cb5f2d9681\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " Jul 27 17:04:09.623964 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.623713 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-serving-cert\") pod \"1503e114-5b6f-42e2-a138-62cb5f2d9681\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " Jul 27 17:04:09.623964 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.623736 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-oauth-config\") pod \"1503e114-5b6f-42e2-a138-62cb5f2d9681\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " Jul 27 17:04:09.623964 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.623758 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-config\") pod \"1503e114-5b6f-42e2-a138-62cb5f2d9681\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " Jul 27 17:04:09.623964 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.623780 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-trusted-ca-bundle\") pod \"1503e114-5b6f-42e2-a138-62cb5f2d9681\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " Jul 27 17:04:09.623964 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.623833 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-service-ca\") pod \"1503e114-5b6f-42e2-a138-62cb5f2d9681\" (UID: \"1503e114-5b6f-42e2-a138-62cb5f2d9681\") " Jul 27 17:04:09.624270 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.624240 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1503e114-5b6f-42e2-a138-62cb5f2d9681" (UID: "1503e114-5b6f-42e2-a138-62cb5f2d9681"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:04:09.624336 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.624286 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-service-ca" (OuterVolumeSpecName: "service-ca") pod "1503e114-5b6f-42e2-a138-62cb5f2d9681" (UID: "1503e114-5b6f-42e2-a138-62cb5f2d9681"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:04:09.624336 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.624295 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-config" (OuterVolumeSpecName: "console-config") pod "1503e114-5b6f-42e2-a138-62cb5f2d9681" (UID: "1503e114-5b6f-42e2-a138-62cb5f2d9681"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:04:09.624336 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.624312 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1503e114-5b6f-42e2-a138-62cb5f2d9681" (UID: "1503e114-5b6f-42e2-a138-62cb5f2d9681"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:04:09.624519 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.624487 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-service-ca\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:04:09.624564 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.624526 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-oauth-serving-cert\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:04:09.624564 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.624536 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-config\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:04:09.624564 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.624546 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1503e114-5b6f-42e2-a138-62cb5f2d9681-trusted-ca-bundle\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:04:09.626341 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.626318 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1503e114-5b6f-42e2-a138-62cb5f2d9681-kube-api-access-kxrxw" (OuterVolumeSpecName: "kube-api-access-kxrxw") pod "1503e114-5b6f-42e2-a138-62cb5f2d9681" (UID: "1503e114-5b6f-42e2-a138-62cb5f2d9681"). InnerVolumeSpecName "kube-api-access-kxrxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:04:09.626660 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.626632 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1503e114-5b6f-42e2-a138-62cb5f2d9681" (UID: "1503e114-5b6f-42e2-a138-62cb5f2d9681"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:04:09.626818 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.626658 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1503e114-5b6f-42e2-a138-62cb5f2d9681" (UID: "1503e114-5b6f-42e2-a138-62cb5f2d9681"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:04:09.725310 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.725272 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxrxw\" (UniqueName: \"kubernetes.io/projected/1503e114-5b6f-42e2-a138-62cb5f2d9681-kube-api-access-kxrxw\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:04:09.725310 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.725305 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-serving-cert\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:04:09.725310 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:09.725314 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1503e114-5b6f-42e2-a138-62cb5f2d9681-console-oauth-config\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:04:10.262697 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:10.262659 2558 generic.go:356] "Generic (PLEG): container finished" podID="1503e114-5b6f-42e2-a138-62cb5f2d9681" containerID="474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1" exitCode=0 Jul 27 17:04:10.263196 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:10.262704 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bbfc8fdd-26hvb" Jul 27 17:04:10.263196 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:10.262747 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bbfc8fdd-26hvb" event={"ID":"1503e114-5b6f-42e2-a138-62cb5f2d9681","Type":"ContainerDied","Data":"474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1"} Jul 27 17:04:10.263196 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:10.262807 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bbfc8fdd-26hvb" event={"ID":"1503e114-5b6f-42e2-a138-62cb5f2d9681","Type":"ContainerDied","Data":"8457443e6a2be1f5ec9f393ce41780ed0ce0198df5dc04b9aa33eacff83a8e2b"} Jul 27 17:04:10.263196 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:10.262839 2558 scope.go:117] "RemoveContainer" containerID="474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1" Jul 27 17:04:10.272415 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:10.272392 2558 scope.go:117] "RemoveContainer" containerID="474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1" Jul 27 17:04:10.272823 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:04:10.272801 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1\": container with ID starting with 474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1 not found: ID does not exist" containerID="474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1" Jul 27 17:04:10.272896 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:10.272830 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1"} err="failed to get container status \"474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1\": rpc error: code = NotFound desc = could not find container \"474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1\": container with ID starting with 474c52d963fa6b6f58bf50d674d43e98f85a3f1ad549a402eb0f0b3a3a25c5a1 not found: ID does not exist" Jul 27 17:04:10.283614 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:10.283579 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bbfc8fdd-26hvb"] Jul 27 17:04:10.285796 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:10.285769 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86bbfc8fdd-26hvb"] Jul 27 17:04:11.247192 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:04:11.247154 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1503e114-5b6f-42e2-a138-62cb5f2d9681" path="/var/lib/kubelet/pods/1503e114-5b6f-42e2-a138-62cb5f2d9681/volumes" Jul 27 17:05:19.171918 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:19.171891 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:05:19.178109 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:19.178085 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:05:19.183189 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:19.183171 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 27 17:05:34.536445 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.536402 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf"] Jul 27 17:05:34.538849 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.536747 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1503e114-5b6f-42e2-a138-62cb5f2d9681" containerName="console" Jul 27 17:05:34.538849 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.536762 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1503e114-5b6f-42e2-a138-62cb5f2d9681" containerName="console" Jul 27 17:05:34.538849 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.536833 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1503e114-5b6f-42e2-a138-62cb5f2d9681" containerName="console" Jul 27 17:05:34.539820 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.539802 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.542594 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.542566 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 27 17:05:34.542753 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.542717 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 27 17:05:34.543759 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.543731 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bgnnc\"" Jul 27 17:05:34.552595 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.552567 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf"] Jul 27 17:05:34.632310 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.632286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.632419 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.632315 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.632419 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.632373 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprdt\" (UniqueName: \"kubernetes.io/projected/053c4b50-5097-4b9e-b1fd-c42b78535364-kube-api-access-tprdt\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.733322 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.733298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprdt\" (UniqueName: \"kubernetes.io/projected/053c4b50-5097-4b9e-b1fd-c42b78535364-kube-api-access-tprdt\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.733459 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.733352 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.733459 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.733382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.733764 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.733739 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.733841 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.733774 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.742803 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.742777 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprdt\" (UniqueName: \"kubernetes.io/projected/053c4b50-5097-4b9e-b1fd-c42b78535364-kube-api-access-tprdt\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.849938 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.849877 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:34.986223 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.986198 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf"] Jul 27 17:05:34.988734 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:05:34.988698 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053c4b50_5097_4b9e_b1fd_c42b78535364.slice/crio-85fc1090ffdf3e3d29c819d0768ade26c314bf493abf5a5acb61932ddbb316d9 WatchSource:0}: Error finding container 85fc1090ffdf3e3d29c819d0768ade26c314bf493abf5a5acb61932ddbb316d9: Status 404 returned error can't find the container with id 85fc1090ffdf3e3d29c819d0768ade26c314bf493abf5a5acb61932ddbb316d9 Jul 27 17:05:34.990705 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:34.990685 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 17:05:35.573267 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:35.573231 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" event={"ID":"053c4b50-5097-4b9e-b1fd-c42b78535364","Type":"ContainerStarted","Data":"85fc1090ffdf3e3d29c819d0768ade26c314bf493abf5a5acb61932ddbb316d9"} Jul 27 17:05:41.598388 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:41.598353 2558 generic.go:356] "Generic (PLEG): container finished" podID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerID="cbf5bc1226b68f6be87f4c315b8fa048aae5864e5a7efc4acff0be5a4c7e22e6" exitCode=0 Jul 27 17:05:41.598771 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:41.598434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" event={"ID":"053c4b50-5097-4b9e-b1fd-c42b78535364","Type":"ContainerDied","Data":"cbf5bc1226b68f6be87f4c315b8fa048aae5864e5a7efc4acff0be5a4c7e22e6"} Jul 27 17:05:44.612683 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:44.612650 2558 generic.go:356] "Generic (PLEG): container finished" podID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerID="1dbd6cfee94e0138f2bbc0dc1ef35523b673d6a00c532cb130abf2e7a5923242" exitCode=0 Jul 27 17:05:44.613048 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:44.612713 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" event={"ID":"053c4b50-5097-4b9e-b1fd-c42b78535364","Type":"ContainerDied","Data":"1dbd6cfee94e0138f2bbc0dc1ef35523b673d6a00c532cb130abf2e7a5923242"} Jul 27 17:05:51.641918 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:51.641883 2558 generic.go:356] "Generic (PLEG): container finished" podID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerID="e6c092f3b28c6054a939ad8a44952a08f15a23acb71d74cbbf16f23b0c295897" exitCode=0 Jul 27 17:05:51.642213 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:51.641941 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" event={"ID":"053c4b50-5097-4b9e-b1fd-c42b78535364","Type":"ContainerDied","Data":"e6c092f3b28c6054a939ad8a44952a08f15a23acb71d74cbbf16f23b0c295897"} Jul 27 17:05:52.790984 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.790960 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:52.865980 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.865950 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-util\") pod \"053c4b50-5097-4b9e-b1fd-c42b78535364\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " Jul 27 17:05:52.866100 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.866020 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-bundle\") pod \"053c4b50-5097-4b9e-b1fd-c42b78535364\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " Jul 27 17:05:52.866100 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.866082 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tprdt\" (UniqueName: \"kubernetes.io/projected/053c4b50-5097-4b9e-b1fd-c42b78535364-kube-api-access-tprdt\") pod \"053c4b50-5097-4b9e-b1fd-c42b78535364\" (UID: \"053c4b50-5097-4b9e-b1fd-c42b78535364\") " Jul 27 17:05:52.866632 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.866602 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-bundle" (OuterVolumeSpecName: "bundle") pod "053c4b50-5097-4b9e-b1fd-c42b78535364" (UID: "053c4b50-5097-4b9e-b1fd-c42b78535364"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 17:05:52.868264 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.868239 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/053c4b50-5097-4b9e-b1fd-c42b78535364-kube-api-access-tprdt" (OuterVolumeSpecName: "kube-api-access-tprdt") pod "053c4b50-5097-4b9e-b1fd-c42b78535364" (UID: "053c4b50-5097-4b9e-b1fd-c42b78535364"). InnerVolumeSpecName "kube-api-access-tprdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:05:52.870300 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.870277 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-util" (OuterVolumeSpecName: "util") pod "053c4b50-5097-4b9e-b1fd-c42b78535364" (UID: "053c4b50-5097-4b9e-b1fd-c42b78535364"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 27 17:05:52.966779 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.966710 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-bundle\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:05:52.966779 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.966743 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tprdt\" (UniqueName: \"kubernetes.io/projected/053c4b50-5097-4b9e-b1fd-c42b78535364-kube-api-access-tprdt\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:05:52.966779 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:52.966758 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/053c4b50-5097-4b9e-b1fd-c42b78535364-util\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:05:53.653153 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:53.653117 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" event={"ID":"053c4b50-5097-4b9e-b1fd-c42b78535364","Type":"ContainerDied","Data":"85fc1090ffdf3e3d29c819d0768ade26c314bf493abf5a5acb61932ddbb316d9"} Jul 27 17:05:53.653290 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:53.653155 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5x4cvf" Jul 27 17:05:53.653290 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:53.653172 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85fc1090ffdf3e3d29c819d0768ade26c314bf493abf5a5acb61932ddbb316d9" Jul 27 17:05:57.402886 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.402858 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn"] Jul 27 17:05:57.403264 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.403109 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerName="extract" Jul 27 17:05:57.403264 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.403120 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerName="extract" Jul 27 17:05:57.403264 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.403133 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerName="pull" Jul 27 17:05:57.403264 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.403139 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerName="pull" Jul 27 17:05:57.403264 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.403146 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerName="util" Jul 27 17:05:57.403264 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.403151 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerName="util" Jul 27 17:05:57.403264 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.403196 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="053c4b50-5097-4b9e-b1fd-c42b78535364" containerName="extract" Jul 27 17:05:57.425567 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.425544 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn"] Jul 27 17:05:57.425708 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.425633 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:05:57.428790 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.428767 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 27 17:05:57.428897 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.428853 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 27 17:05:57.429053 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.429036 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-m9vzv\"" Jul 27 17:05:57.429271 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.429258 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 27 17:05:57.494151 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.494127 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d7b119cb-355c-46f3-9b63-95a2bf97a659-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn\" (UID: \"d7b119cb-355c-46f3-9b63-95a2bf97a659\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:05:57.494245 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.494156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg67j\" (UniqueName: \"kubernetes.io/projected/d7b119cb-355c-46f3-9b63-95a2bf97a659-kube-api-access-dg67j\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn\" (UID: \"d7b119cb-355c-46f3-9b63-95a2bf97a659\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:05:57.594761 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.594734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d7b119cb-355c-46f3-9b63-95a2bf97a659-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn\" (UID: \"d7b119cb-355c-46f3-9b63-95a2bf97a659\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:05:57.594865 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.594770 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg67j\" (UniqueName: \"kubernetes.io/projected/d7b119cb-355c-46f3-9b63-95a2bf97a659-kube-api-access-dg67j\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn\" (UID: \"d7b119cb-355c-46f3-9b63-95a2bf97a659\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:05:57.597290 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.597272 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d7b119cb-355c-46f3-9b63-95a2bf97a659-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn\" (UID: \"d7b119cb-355c-46f3-9b63-95a2bf97a659\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:05:57.603496 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.603465 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg67j\" (UniqueName: \"kubernetes.io/projected/d7b119cb-355c-46f3-9b63-95a2bf97a659-kube-api-access-dg67j\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn\" (UID: \"d7b119cb-355c-46f3-9b63-95a2bf97a659\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:05:57.735275 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.735216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:05:57.890434 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:57.890411 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn"] Jul 27 17:05:57.892678 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:05:57.892654 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b119cb_355c_46f3_9b63_95a2bf97a659.slice/crio-ca420f67bfed490cf9a1933c1b99485972720de43dcf0c948fff7d45742936b7 WatchSource:0}: Error finding container ca420f67bfed490cf9a1933c1b99485972720de43dcf0c948fff7d45742936b7: Status 404 returned error can't find the container with id ca420f67bfed490cf9a1933c1b99485972720de43dcf0c948fff7d45742936b7 Jul 27 17:05:58.679392 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:05:58.679362 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" event={"ID":"d7b119cb-355c-46f3-9b63-95a2bf97a659","Type":"ContainerStarted","Data":"ca420f67bfed490cf9a1933c1b99485972720de43dcf0c948fff7d45742936b7"} Jul 27 17:06:02.684458 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.684425 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-r6ndw"] Jul 27 17:06:02.686435 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.686418 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:02.688863 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.688836 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 27 17:06:02.688863 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.688850 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-dm9b9\"" Jul 27 17:06:02.689107 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.689092 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 27 17:06:02.697685 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.697664 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-r6ndw"] Jul 27 17:06:02.699375 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.699345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" event={"ID":"d7b119cb-355c-46f3-9b63-95a2bf97a659","Type":"ContainerStarted","Data":"5e5bac47336171d8afaa2d45db09cfab3067a89c926674aaa5a9383cc31b86b6"} Jul 27 17:06:02.699462 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.699404 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:06:02.728582 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.728534 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" podStartSLOduration=1.659883257 podStartE2EDuration="5.728496959s" totalImagesPullingTime="4.068613702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:06:02.727216609 +0000 UTC m=+343.975853114" watchObservedRunningTime="2026-07-27 17:06:02.728496959 +0000 UTC m=+343.977133448" Jul 27 17:06:02.734740 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.734718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1cf92561-9b0d-496e-8b2c-a22916cde210-certificates\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:02.734832 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.734754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqxpd\" (UniqueName: \"kubernetes.io/projected/1cf92561-9b0d-496e-8b2c-a22916cde210-kube-api-access-bqxpd\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:02.734832 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.734775 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/1cf92561-9b0d-496e-8b2c-a22916cde210-cabundle0\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:02.835814 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.835790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1cf92561-9b0d-496e-8b2c-a22916cde210-certificates\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:02.835904 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.835847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqxpd\" (UniqueName: \"kubernetes.io/projected/1cf92561-9b0d-496e-8b2c-a22916cde210-kube-api-access-bqxpd\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:02.835904 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.835891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/1cf92561-9b0d-496e-8b2c-a22916cde210-cabundle0\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:02.835993 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:06:02.835952 2558 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 27 17:06:02.835993 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:06:02.835969 2558 secret.go:281] references non-existent secret key: ca.crt Jul 27 17:06:02.835993 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:06:02.835979 2558 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 27 17:06:02.836109 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:06:02.835994 2558 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-r6ndw: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 27 17:06:02.836109 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:06:02.836055 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cf92561-9b0d-496e-8b2c-a22916cde210-certificates podName:1cf92561-9b0d-496e-8b2c-a22916cde210 nodeName:}" failed. No retries permitted until 2026-07-27 17:06:03.336038423 +0000 UTC m=+344.584674889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/1cf92561-9b0d-496e-8b2c-a22916cde210-certificates") pod "keda-operator-77f648d694-r6ndw" (UID: "1cf92561-9b0d-496e-8b2c-a22916cde210") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 27 17:06:02.836474 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.836456 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/1cf92561-9b0d-496e-8b2c-a22916cde210-cabundle0\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:02.846771 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.846747 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqxpd\" (UniqueName: \"kubernetes.io/projected/1cf92561-9b0d-496e-8b2c-a22916cde210-kube-api-access-bqxpd\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:02.909877 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.909846 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc"] Jul 27 17:06:02.912216 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.912198 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:02.914464 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.914444 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 27 17:06:02.921107 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:02.921085 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc"] Jul 27 17:06:03.038001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.037977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/fdbd842c-4cd4-4400-b04d-a25ba961eef8-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-qr8zc\" (UID: \"fdbd842c-4cd4-4400-b04d-a25ba961eef8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.038089 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.038066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnznh\" (UniqueName: \"kubernetes.io/projected/fdbd842c-4cd4-4400-b04d-a25ba961eef8-kube-api-access-rnznh\") pod \"keda-metrics-apiserver-55557df8c-qr8zc\" (UID: \"fdbd842c-4cd4-4400-b04d-a25ba961eef8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.038089 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.038086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fdbd842c-4cd4-4400-b04d-a25ba961eef8-certificates\") pod \"keda-metrics-apiserver-55557df8c-qr8zc\" (UID: \"fdbd842c-4cd4-4400-b04d-a25ba961eef8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.138389 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.138363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnznh\" (UniqueName: \"kubernetes.io/projected/fdbd842c-4cd4-4400-b04d-a25ba961eef8-kube-api-access-rnznh\") pod \"keda-metrics-apiserver-55557df8c-qr8zc\" (UID: \"fdbd842c-4cd4-4400-b04d-a25ba961eef8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.138494 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.138394 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fdbd842c-4cd4-4400-b04d-a25ba961eef8-certificates\") pod \"keda-metrics-apiserver-55557df8c-qr8zc\" (UID: \"fdbd842c-4cd4-4400-b04d-a25ba961eef8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.138494 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.138424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/fdbd842c-4cd4-4400-b04d-a25ba961eef8-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-qr8zc\" (UID: \"fdbd842c-4cd4-4400-b04d-a25ba961eef8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.138806 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.138786 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/fdbd842c-4cd4-4400-b04d-a25ba961eef8-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-qr8zc\" (UID: \"fdbd842c-4cd4-4400-b04d-a25ba961eef8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.141216 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.141194 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fdbd842c-4cd4-4400-b04d-a25ba961eef8-certificates\") pod \"keda-metrics-apiserver-55557df8c-qr8zc\" (UID: \"fdbd842c-4cd4-4400-b04d-a25ba961eef8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.146234 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.146215 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnznh\" (UniqueName: \"kubernetes.io/projected/fdbd842c-4cd4-4400-b04d-a25ba961eef8-kube-api-access-rnznh\") pod \"keda-metrics-apiserver-55557df8c-qr8zc\" (UID: \"fdbd842c-4cd4-4400-b04d-a25ba961eef8\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.223145 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.223113 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:03.293891 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.293818 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-nr4bl"] Jul 27 17:06:03.297004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.296981 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:03.299771 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.299750 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 27 17:06:03.307547 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.307490 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-nr4bl"] Jul 27 17:06:03.340334 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.340261 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glmgg\" (UniqueName: \"kubernetes.io/projected/de8fd6de-5802-4353-9e06-b11146f86c00-kube-api-access-glmgg\") pod \"keda-admission-56f9798bb4-nr4bl\" (UID: \"de8fd6de-5802-4353-9e06-b11146f86c00\") " pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:03.340482 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.340355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/de8fd6de-5802-4353-9e06-b11146f86c00-certificates\") pod \"keda-admission-56f9798bb4-nr4bl\" (UID: \"de8fd6de-5802-4353-9e06-b11146f86c00\") " pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:03.340482 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.340416 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1cf92561-9b0d-496e-8b2c-a22916cde210-certificates\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:03.343684 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.343661 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1cf92561-9b0d-496e-8b2c-a22916cde210-certificates\") pod \"keda-operator-77f648d694-r6ndw\" (UID: \"1cf92561-9b0d-496e-8b2c-a22916cde210\") " pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:03.440960 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.440938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/de8fd6de-5802-4353-9e06-b11146f86c00-certificates\") pod \"keda-admission-56f9798bb4-nr4bl\" (UID: \"de8fd6de-5802-4353-9e06-b11146f86c00\") " pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:03.441058 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.440981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glmgg\" (UniqueName: \"kubernetes.io/projected/de8fd6de-5802-4353-9e06-b11146f86c00-kube-api-access-glmgg\") pod \"keda-admission-56f9798bb4-nr4bl\" (UID: \"de8fd6de-5802-4353-9e06-b11146f86c00\") " pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:03.441103 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:06:03.441087 2558 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 27 17:06:03.441137 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:06:03.441112 2558 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-nr4bl: secret "keda-admission-webhooks-certs" not found Jul 27 17:06:03.441169 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:06:03.441158 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de8fd6de-5802-4353-9e06-b11146f86c00-certificates podName:de8fd6de-5802-4353-9e06-b11146f86c00 nodeName:}" failed. No retries permitted until 2026-07-27 17:06:03.94114427 +0000 UTC m=+345.189780735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/de8fd6de-5802-4353-9e06-b11146f86c00-certificates") pod "keda-admission-56f9798bb4-nr4bl" (UID: "de8fd6de-5802-4353-9e06-b11146f86c00") : secret "keda-admission-webhooks-certs" not found Jul 27 17:06:03.449903 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.449881 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glmgg\" (UniqueName: \"kubernetes.io/projected/de8fd6de-5802-4353-9e06-b11146f86c00-kube-api-access-glmgg\") pod \"keda-admission-56f9798bb4-nr4bl\" (UID: \"de8fd6de-5802-4353-9e06-b11146f86c00\") " pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:03.596478 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.596414 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:03.597358 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.597335 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc"] Jul 27 17:06:03.599324 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:06:03.599303 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbd842c_4cd4_4400_b04d_a25ba961eef8.slice/crio-396bf53fd7488170b12fc37ba5258adb753d6882d8c4a546a637cddd501e938d WatchSource:0}: Error finding container 396bf53fd7488170b12fc37ba5258adb753d6882d8c4a546a637cddd501e938d: Status 404 returned error can't find the container with id 396bf53fd7488170b12fc37ba5258adb753d6882d8c4a546a637cddd501e938d Jul 27 17:06:03.706482 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.706444 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" event={"ID":"fdbd842c-4cd4-4400-b04d-a25ba961eef8","Type":"ContainerStarted","Data":"396bf53fd7488170b12fc37ba5258adb753d6882d8c4a546a637cddd501e938d"} Jul 27 17:06:03.747750 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.747728 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-r6ndw"] Jul 27 17:06:03.749601 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:06:03.749571 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf92561_9b0d_496e_8b2c_a22916cde210.slice/crio-12afa78b26e9397dde7aa4fc0278b05a5cf62756188bb3d6b69c19edf8942e23 WatchSource:0}: Error finding container 12afa78b26e9397dde7aa4fc0278b05a5cf62756188bb3d6b69c19edf8942e23: Status 404 returned error can't find the container with id 12afa78b26e9397dde7aa4fc0278b05a5cf62756188bb3d6b69c19edf8942e23 Jul 27 17:06:03.944823 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.944763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/de8fd6de-5802-4353-9e06-b11146f86c00-certificates\") pod \"keda-admission-56f9798bb4-nr4bl\" (UID: \"de8fd6de-5802-4353-9e06-b11146f86c00\") " pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:03.947148 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:03.947131 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/de8fd6de-5802-4353-9e06-b11146f86c00-certificates\") pod \"keda-admission-56f9798bb4-nr4bl\" (UID: \"de8fd6de-5802-4353-9e06-b11146f86c00\") " pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:04.210338 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:04.210281 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:04.337331 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:04.337304 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-nr4bl"] Jul 27 17:06:04.340240 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:06:04.340216 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8fd6de_5802_4353_9e06_b11146f86c00.slice/crio-287c050b05ebf386f1da02289f908b42b3efd1c68d567e5b14b8a0c4d58ec997 WatchSource:0}: Error finding container 287c050b05ebf386f1da02289f908b42b3efd1c68d567e5b14b8a0c4d58ec997: Status 404 returned error can't find the container with id 287c050b05ebf386f1da02289f908b42b3efd1c68d567e5b14b8a0c4d58ec997 Jul 27 17:06:04.713241 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:04.713204 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-r6ndw" event={"ID":"1cf92561-9b0d-496e-8b2c-a22916cde210","Type":"ContainerStarted","Data":"12afa78b26e9397dde7aa4fc0278b05a5cf62756188bb3d6b69c19edf8942e23"} Jul 27 17:06:04.714787 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:04.714754 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" event={"ID":"de8fd6de-5802-4353-9e06-b11146f86c00","Type":"ContainerStarted","Data":"287c050b05ebf386f1da02289f908b42b3efd1c68d567e5b14b8a0c4d58ec997"} Jul 27 17:06:06.726539 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:06.726489 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" event={"ID":"de8fd6de-5802-4353-9e06-b11146f86c00","Type":"ContainerStarted","Data":"7a89321d35231cc3a58868f2f80e82cbcfbc2605a2c6637fa88c6751c1554997"} Jul 27 17:06:06.726984 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:06.726585 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:06.746409 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:06.746356 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" podStartSLOduration=2.2796847 podStartE2EDuration="3.746342493s" totalImagesPullingTime="1.466657793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:06:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:06:06.744954389 +0000 UTC m=+347.993590880" watchObservedRunningTime="2026-07-27 17:06:06.746342493 +0000 UTC m=+347.994978982" Jul 27 17:06:08.737752 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:08.737699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" event={"ID":"fdbd842c-4cd4-4400-b04d-a25ba961eef8","Type":"ContainerStarted","Data":"fcb911053c3320f416ca743f6ccabd1c98bcf0b4d6929ae1c5010d3635f9fd59"} Jul 27 17:06:08.738195 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:08.737825 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:08.739562 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:08.739532 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-r6ndw" event={"ID":"1cf92561-9b0d-496e-8b2c-a22916cde210","Type":"ContainerStarted","Data":"a64904044b8d3e379038b0af06f30f1aeeb3338a63a95c1c3ca2bc4f50aa6d59"} Jul 27 17:06:08.739708 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:08.739689 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:06:08.755345 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:08.755292 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" podStartSLOduration=2.472613161 podStartE2EDuration="6.755277259s" totalImagesPullingTime="4.282664098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:06:08.754012554 +0000 UTC m=+350.002649042" watchObservedRunningTime="2026-07-27 17:06:08.755277259 +0000 UTC m=+350.003913746" Jul 27 17:06:08.769623 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:08.769583 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-r6ndw" podStartSLOduration=2.630883233 podStartE2EDuration="6.769574104s" totalImagesPullingTime="4.138690871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:06:08.768821501 +0000 UTC m=+350.017457989" watchObservedRunningTime="2026-07-27 17:06:08.769574104 +0000 UTC m=+350.018210662" Jul 27 17:06:19.747925 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:19.747849 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-qr8zc" Jul 27 17:06:23.708844 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:23.708815 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hxgjn" Jul 27 17:06:27.733677 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:27.733648 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-nr4bl" Jul 27 17:06:29.745871 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:06:29.745844 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-r6ndw" Jul 27 17:07:13.664045 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.664013 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7b85f6bf-lz4dg"] Jul 27 17:07:13.668213 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.668188 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.678956 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.678936 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7b85f6bf-lz4dg"] Jul 27 17:07:13.724299 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.724277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-trusted-ca-bundle\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.724407 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.724302 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4cdp\" (UniqueName: \"kubernetes.io/projected/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-kube-api-access-g4cdp\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.724407 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.724331 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-service-ca\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.724407 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.724385 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-console-serving-cert\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.724407 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.724407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-console-config\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.724604 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.724424 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-console-oauth-config\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.724604 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.724437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-oauth-serving-cert\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.824690 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.824667 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-console-serving-cert\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.824796 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.824699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-console-config\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.824796 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.824717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-console-oauth-config\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.824796 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.824732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-oauth-serving-cert\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.824927 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.824846 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-trusted-ca-bundle\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.824927 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.824879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4cdp\" (UniqueName: \"kubernetes.io/projected/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-kube-api-access-g4cdp\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.824927 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.824920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-service-ca\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.825460 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.825433 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-oauth-serving-cert\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.825586 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.825448 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-console-config\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.825586 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.825567 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-service-ca\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.825734 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.825713 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-trusted-ca-bundle\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.827648 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.827627 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-console-serving-cert\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.827714 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.827650 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-console-oauth-config\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.833300 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.833276 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4cdp\" (UniqueName: \"kubernetes.io/projected/aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35-kube-api-access-g4cdp\") pod \"console-6d7b85f6bf-lz4dg\" (UID: \"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35\") " pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:13.979798 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:13.979734 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:14.312004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:14.311977 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7b85f6bf-lz4dg"] Jul 27 17:07:14.314803 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:07:14.314778 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb36aea_30b0_4f1f_bf98_ef69d1ad2e35.slice/crio-ce61f29d5869913fbcdeea8962fbcfd37f1111c3a45399f6f4777b7863a5f97f WatchSource:0}: Error finding container ce61f29d5869913fbcdeea8962fbcfd37f1111c3a45399f6f4777b7863a5f97f: Status 404 returned error can't find the container with id ce61f29d5869913fbcdeea8962fbcfd37f1111c3a45399f6f4777b7863a5f97f Jul 27 17:07:14.999983 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:14.999951 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7b85f6bf-lz4dg" event={"ID":"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35","Type":"ContainerStarted","Data":"faa2e8542d9e92b724fdbbb9241eec945d3f1dd7242b604a6d96a88945aaf589"} Jul 27 17:07:15.000335 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:15.000001 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7b85f6bf-lz4dg" event={"ID":"aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35","Type":"ContainerStarted","Data":"ce61f29d5869913fbcdeea8962fbcfd37f1111c3a45399f6f4777b7863a5f97f"} Jul 27 17:07:15.021001 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:15.020959 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d7b85f6bf-lz4dg" podStartSLOduration=2.020945751 podStartE2EDuration="2.020945751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:07:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:07:15.019837781 +0000 UTC m=+416.268474270" watchObservedRunningTime="2026-07-27 17:07:15.020945751 +0000 UTC m=+416.269582236" Jul 27 17:07:23.142941 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.142907 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-gk8nx"] Jul 27 17:07:23.146284 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.146265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:23.152842 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.152816 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 27 17:07:23.152842 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.152832 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 27 17:07:23.159835 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.159819 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 27 17:07:23.160991 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.160974 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-zqwv5\"" Jul 27 17:07:23.186632 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.186603 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d127492-4734-46ab-bc02-f03642552868-cert\") pod \"llmisvc-controller-manager-654c557856-gk8nx\" (UID: \"9d127492-4734-46ab-bc02-f03642552868\") " pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:23.186723 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.186650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjvpr\" (UniqueName: \"kubernetes.io/projected/9d127492-4734-46ab-bc02-f03642552868-kube-api-access-tjvpr\") pod \"llmisvc-controller-manager-654c557856-gk8nx\" (UID: \"9d127492-4734-46ab-bc02-f03642552868\") " pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:23.186884 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.186867 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-gk8nx"] Jul 27 17:07:23.287721 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.287699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d127492-4734-46ab-bc02-f03642552868-cert\") pod \"llmisvc-controller-manager-654c557856-gk8nx\" (UID: \"9d127492-4734-46ab-bc02-f03642552868\") " pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:23.287845 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.287734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjvpr\" (UniqueName: \"kubernetes.io/projected/9d127492-4734-46ab-bc02-f03642552868-kube-api-access-tjvpr\") pod \"llmisvc-controller-manager-654c557856-gk8nx\" (UID: \"9d127492-4734-46ab-bc02-f03642552868\") " pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:23.290119 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.290099 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d127492-4734-46ab-bc02-f03642552868-cert\") pod \"llmisvc-controller-manager-654c557856-gk8nx\" (UID: \"9d127492-4734-46ab-bc02-f03642552868\") " pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:23.296739 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.296720 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjvpr\" (UniqueName: \"kubernetes.io/projected/9d127492-4734-46ab-bc02-f03642552868-kube-api-access-tjvpr\") pod \"llmisvc-controller-manager-654c557856-gk8nx\" (UID: \"9d127492-4734-46ab-bc02-f03642552868\") " pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:23.455523 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.455443 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:23.584843 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.584819 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-gk8nx"] Jul 27 17:07:23.587216 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:07:23.587186 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9d127492_4734_46ab_bc02_f03642552868.slice/crio-4f76903ee18d15f02b6df33261e55867d015cb6206c5f2103f479deeb85a59b8 WatchSource:0}: Error finding container 4f76903ee18d15f02b6df33261e55867d015cb6206c5f2103f479deeb85a59b8: Status 404 returned error can't find the container with id 4f76903ee18d15f02b6df33261e55867d015cb6206c5f2103f479deeb85a59b8 Jul 27 17:07:23.980454 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.980430 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:23.980593 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.980474 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:23.984746 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:23.984729 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:24.036033 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:24.036003 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerStarted","Data":"4f76903ee18d15f02b6df33261e55867d015cb6206c5f2103f479deeb85a59b8"} Jul 27 17:07:24.039612 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:24.039594 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7b85f6bf-lz4dg" Jul 27 17:07:24.090647 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:24.090622 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-697649c4d8-d9q8x"] Jul 27 17:07:27.050324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:27.050294 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d127492-4734-46ab-bc02-f03642552868" containerID="bb73428b1c931bc34d38ba49341cdcd432a2da2addef8ffb1f754b70109ece52" exitCode=1 Jul 27 17:07:27.050628 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:27.050328 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerDied","Data":"bb73428b1c931bc34d38ba49341cdcd432a2da2addef8ffb1f754b70109ece52"} Jul 27 17:07:27.050628 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:27.050564 2558 scope.go:117] "RemoveContainer" containerID="bb73428b1c931bc34d38ba49341cdcd432a2da2addef8ffb1f754b70109ece52" Jul 27 17:07:28.055973 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:28.055944 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerStarted","Data":"3f52c26a4b66f5ad8c87726ce35a0d76c7bd19a9becd612d0f657b4915cbe96b"} Jul 27 17:07:28.056287 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:28.056035 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:28.072902 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:28.072863 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podStartSLOduration=2.055772123 podStartE2EDuration="5.072850777s" totalImagesPullingTime="3.017078654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 17:07:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:07:28.072694972 +0000 UTC m=+429.321331458" watchObservedRunningTime="2026-07-27 17:07:28.072850777 +0000 UTC m=+429.321487263" Jul 27 17:07:29.062014 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:29.061988 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d127492-4734-46ab-bc02-f03642552868" containerID="3f52c26a4b66f5ad8c87726ce35a0d76c7bd19a9becd612d0f657b4915cbe96b" exitCode=1 Jul 27 17:07:29.062309 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:29.062026 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerDied","Data":"3f52c26a4b66f5ad8c87726ce35a0d76c7bd19a9becd612d0f657b4915cbe96b"} Jul 27 17:07:29.062309 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:29.062067 2558 scope.go:117] "RemoveContainer" containerID="bb73428b1c931bc34d38ba49341cdcd432a2da2addef8ffb1f754b70109ece52" Jul 27 17:07:29.062309 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:29.062220 2558 scope.go:117] "RemoveContainer" containerID="3f52c26a4b66f5ad8c87726ce35a0d76c7bd19a9becd612d0f657b4915cbe96b" Jul 27 17:07:29.062432 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:07:29.062405 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:07:30.067431 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:30.067406 2558 scope.go:117] "RemoveContainer" containerID="3f52c26a4b66f5ad8c87726ce35a0d76c7bd19a9becd612d0f657b4915cbe96b" Jul 27 17:07:30.067797 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:07:30.067559 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:07:33.456376 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:33.456342 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:33.456758 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:33.456664 2558 scope.go:117] "RemoveContainer" containerID="3f52c26a4b66f5ad8c87726ce35a0d76c7bd19a9becd612d0f657b4915cbe96b" Jul 27 17:07:33.456819 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:07:33.456800 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:07:46.242774 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:46.242712 2558 scope.go:117] "RemoveContainer" containerID="3f52c26a4b66f5ad8c87726ce35a0d76c7bd19a9becd612d0f657b4915cbe96b" Jul 27 17:07:47.133517 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:47.133466 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerStarted","Data":"35001d258693626b8a6dfa07eed3690bb49958a91af861c6eebbe9ab4f17a486"} Jul 27 17:07:47.133761 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:47.133742 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:48.138732 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:48.138704 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d127492-4734-46ab-bc02-f03642552868" containerID="35001d258693626b8a6dfa07eed3690bb49958a91af861c6eebbe9ab4f17a486" exitCode=1 Jul 27 17:07:48.139041 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:48.138789 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerDied","Data":"35001d258693626b8a6dfa07eed3690bb49958a91af861c6eebbe9ab4f17a486"} Jul 27 17:07:48.139041 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:48.138842 2558 scope.go:117] "RemoveContainer" containerID="3f52c26a4b66f5ad8c87726ce35a0d76c7bd19a9becd612d0f657b4915cbe96b" Jul 27 17:07:48.139041 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:48.139027 2558 scope.go:117] "RemoveContainer" containerID="35001d258693626b8a6dfa07eed3690bb49958a91af861c6eebbe9ab4f17a486" Jul 27 17:07:48.139181 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:07:48.139169 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:07:49.111558 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.111528 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-697649c4d8-d9q8x" podUID="e563feeb-864b-455c-8bde-969be3194d8c" containerName="console" containerID="cri-o://7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a" gracePeriod=15 Jul 27 17:07:49.144761 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.144739 2558 scope.go:117] "RemoveContainer" containerID="35001d258693626b8a6dfa07eed3690bb49958a91af861c6eebbe9ab4f17a486" Jul 27 17:07:49.145042 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:07:49.144884 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:07:49.363786 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.363725 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:07:49.471082 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471056 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-oauth-config\") pod \"e563feeb-864b-455c-8bde-969be3194d8c\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " Jul 27 17:07:49.471215 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471086 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-trusted-ca-bundle\") pod \"e563feeb-864b-455c-8bde-969be3194d8c\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " Jul 27 17:07:49.471215 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471112 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-service-ca\") pod \"e563feeb-864b-455c-8bde-969be3194d8c\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " Jul 27 17:07:49.471215 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471151 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-oauth-serving-cert\") pod \"e563feeb-864b-455c-8bde-969be3194d8c\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " Jul 27 17:07:49.471215 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471190 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w4px\" (UniqueName: \"kubernetes.io/projected/e563feeb-864b-455c-8bde-969be3194d8c-kube-api-access-2w4px\") pod \"e563feeb-864b-455c-8bde-969be3194d8c\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " Jul 27 17:07:49.471215 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471213 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-serving-cert\") pod \"e563feeb-864b-455c-8bde-969be3194d8c\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " Jul 27 17:07:49.471464 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471245 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-console-config\") pod \"e563feeb-864b-455c-8bde-969be3194d8c\" (UID: \"e563feeb-864b-455c-8bde-969be3194d8c\") " Jul 27 17:07:49.471563 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471537 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e563feeb-864b-455c-8bde-969be3194d8c" (UID: "e563feeb-864b-455c-8bde-969be3194d8c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:07:49.471726 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471701 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-service-ca" (OuterVolumeSpecName: "service-ca") pod "e563feeb-864b-455c-8bde-969be3194d8c" (UID: "e563feeb-864b-455c-8bde-969be3194d8c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:07:49.471726 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471711 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e563feeb-864b-455c-8bde-969be3194d8c" (UID: "e563feeb-864b-455c-8bde-969be3194d8c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:07:49.471836 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.471747 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-console-config" (OuterVolumeSpecName: "console-config") pod "e563feeb-864b-455c-8bde-969be3194d8c" (UID: "e563feeb-864b-455c-8bde-969be3194d8c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 27 17:07:49.473374 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.473349 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e563feeb-864b-455c-8bde-969be3194d8c-kube-api-access-2w4px" (OuterVolumeSpecName: "kube-api-access-2w4px") pod "e563feeb-864b-455c-8bde-969be3194d8c" (UID: "e563feeb-864b-455c-8bde-969be3194d8c"). InnerVolumeSpecName "kube-api-access-2w4px". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 27 17:07:49.473768 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.473748 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e563feeb-864b-455c-8bde-969be3194d8c" (UID: "e563feeb-864b-455c-8bde-969be3194d8c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:07:49.473768 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.473758 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e563feeb-864b-455c-8bde-969be3194d8c" (UID: "e563feeb-864b-455c-8bde-969be3194d8c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 27 17:07:49.572312 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.572294 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-oauth-serving-cert\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:07:49.572312 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.572313 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w4px\" (UniqueName: \"kubernetes.io/projected/e563feeb-864b-455c-8bde-969be3194d8c-kube-api-access-2w4px\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:07:49.572428 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.572322 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-serving-cert\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:07:49.572428 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.572331 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-console-config\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:07:49.572428 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.572338 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e563feeb-864b-455c-8bde-969be3194d8c-console-oauth-config\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:07:49.572428 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.572346 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-trusted-ca-bundle\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:07:49.572428 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:49.572354 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e563feeb-864b-455c-8bde-969be3194d8c-service-ca\") on node \"ip-10-0-140-73.ec2.internal\" DevicePath \"\"" Jul 27 17:07:50.150004 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:50.149977 2558 generic.go:356] "Generic (PLEG): container finished" podID="e563feeb-864b-455c-8bde-969be3194d8c" containerID="7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a" exitCode=0 Jul 27 17:07:50.150337 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:50.150024 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-697649c4d8-d9q8x" Jul 27 17:07:50.150337 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:50.150064 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697649c4d8-d9q8x" event={"ID":"e563feeb-864b-455c-8bde-969be3194d8c","Type":"ContainerDied","Data":"7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a"} Jul 27 17:07:50.150337 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:50.150115 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-697649c4d8-d9q8x" event={"ID":"e563feeb-864b-455c-8bde-969be3194d8c","Type":"ContainerDied","Data":"258fb827aa088e78d823ec5160b5080ed3e57b1552236a35c33082b291eebed7"} Jul 27 17:07:50.150337 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:50.150137 2558 scope.go:117] "RemoveContainer" containerID="7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a" Jul 27 17:07:50.158724 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:50.158710 2558 scope.go:117] "RemoveContainer" containerID="7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a" Jul 27 17:07:50.158968 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:07:50.158952 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a\": container with ID starting with 7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a not found: ID does not exist" containerID="7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a" Jul 27 17:07:50.159023 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:50.158971 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a"} err="failed to get container status \"7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a\": rpc error: code = NotFound desc = could not find container \"7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a\": container with ID starting with 7c23778bf13a0a4fad2565e8e7774eec609934e1d408ffff025b232794b6185a not found: ID does not exist" Jul 27 17:07:50.170965 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:50.170931 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-697649c4d8-d9q8x"] Jul 27 17:07:50.172778 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:50.172761 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-697649c4d8-d9q8x"] Jul 27 17:07:51.246766 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:51.246739 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e563feeb-864b-455c-8bde-969be3194d8c" path="/var/lib/kubelet/pods/e563feeb-864b-455c-8bde-969be3194d8c/volumes" Jul 27 17:07:53.456108 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:53.456081 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:07:53.456439 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:07:53.456330 2558 scope.go:117] "RemoveContainer" containerID="35001d258693626b8a6dfa07eed3690bb49958a91af861c6eebbe9ab4f17a486" Jul 27 17:07:53.456488 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:07:53.456446 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:08:07.242619 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:07.242589 2558 scope.go:117] "RemoveContainer" containerID="35001d258693626b8a6dfa07eed3690bb49958a91af861c6eebbe9ab4f17a486" Jul 27 17:08:07.243068 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:08:07.242804 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:08:20.242081 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:20.242053 2558 scope.go:117] "RemoveContainer" containerID="35001d258693626b8a6dfa07eed3690bb49958a91af861c6eebbe9ab4f17a486" Jul 27 17:08:21.286767 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:21.286731 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerStarted","Data":"833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8"} Jul 27 17:08:21.287129 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:21.286946 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:08:22.292705 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:22.292676 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d127492-4734-46ab-bc02-f03642552868" containerID="833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8" exitCode=1 Jul 27 17:08:22.293113 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:22.292725 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerDied","Data":"833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8"} Jul 27 17:08:22.293113 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:22.292782 2558 scope.go:117] "RemoveContainer" containerID="35001d258693626b8a6dfa07eed3690bb49958a91af861c6eebbe9ab4f17a486" Jul 27 17:08:22.293113 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:22.292940 2558 scope.go:117] "RemoveContainer" containerID="833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8" Jul 27 17:08:22.293241 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:08:22.293112 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:08:23.298479 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:23.298451 2558 scope.go:117] "RemoveContainer" containerID="833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8" Jul 27 17:08:23.298878 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:08:23.298654 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:08:23.456293 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:23.456264 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:08:24.302811 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:24.302783 2558 scope.go:117] "RemoveContainer" containerID="833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8" Jul 27 17:08:24.303192 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:08:24.302958 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:08:35.242721 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:35.242687 2558 scope.go:117] "RemoveContainer" containerID="833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8" Jul 27 17:08:35.243186 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:08:35.242862 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:08:47.242833 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:47.242793 2558 scope.go:117] "RemoveContainer" containerID="833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8" Jul 27 17:08:47.243340 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:08:47.242987 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:08:58.242254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:08:58.242222 2558 scope.go:117] "RemoveContainer" containerID="833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8" Jul 27 17:08:58.242671 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:08:58.242381 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:09:09.243977 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:09.243946 2558 scope.go:117] "RemoveContainer" containerID="833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8" Jul 27 17:09:10.454342 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:09:10.454316 2558 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-pod9d127492_4734_46ab_bc02_f03642552868.slice/crio-conmon-51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399.scope\": RecentStats: unable to find data in memory cache]" Jul 27 17:09:10.492455 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:10.492430 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d127492-4734-46ab-bc02-f03642552868" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" exitCode=1 Jul 27 17:09:10.492572 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:10.492463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerDied","Data":"51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399"} Jul 27 17:09:10.492572 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:10.492550 2558 scope.go:117] "RemoveContainer" containerID="833e3d77a166fd1c8528f309d1b11a1b859e43b58f5442bfe7bdfb44fbc235b8" Jul 27 17:09:10.492920 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:10.492902 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:09:10.493088 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:09:10.493066 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:09:11.287685 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:11.287653 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:09:11.499378 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:11.499351 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:09:11.499909 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:09:11.499601 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:09:13.456397 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:13.456365 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:09:13.456820 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:13.456700 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:09:13.456877 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:09:13.456855 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:09:27.242254 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:27.242220 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:09:27.242738 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:09:27.242401 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:09:40.242821 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:40.242782 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:09:40.243439 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:09:40.243006 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:09:51.242324 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:09:51.242290 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:09:51.242752 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:09:51.242493 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:10:03.242825 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:03.242797 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:10:03.243205 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:10:03.242983 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:10:16.242585 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:16.242546 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:10:16.243122 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:10:16.242787 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:10:19.199467 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:19.199435 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:10:19.202742 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:19.202714 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:10:27.242557 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:27.242527 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:10:27.242992 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:10:27.242680 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:10:40.242757 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:40.242718 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:10:40.245170 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:40.243027 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 27 17:10:40.879028 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:40.878992 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerStarted","Data":"d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd"} Jul 27 17:10:40.879258 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:40.879241 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:10:41.885705 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:41.885614 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d127492-4734-46ab-bc02-f03642552868" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" exitCode=1 Jul 27 17:10:41.885705 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:41.885691 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerDied","Data":"d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd"} Jul 27 17:10:41.886119 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:41.885755 2558 scope.go:117] "RemoveContainer" containerID="51426b755c8cee92b0eea54be48b206b7c4dc7ce761efe42d67bf894aa971399" Jul 27 17:10:41.886119 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:41.885987 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:10:41.886238 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:10:41.886216 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:10:42.891342 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:42.891315 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:10:42.891732 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:10:42.891514 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:10:43.456129 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:43.456077 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:10:43.894943 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:43.894906 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:10:43.895416 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:10:43.895142 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:10:57.242640 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:10:57.242605 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:10:57.243058 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:10:57.242818 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:11:11.242227 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:11:11.242199 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:11:11.242648 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:11:11.242358 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:11:24.242480 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:11:24.242450 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:11:24.242906 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:11:24.242661 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:11:35.243010 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:11:35.242972 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:11:35.243429 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:11:35.243191 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:11:47.242477 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:11:47.242435 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:11:47.242988 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:11:47.242685 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:12:00.242935 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:12:00.242907 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:12:00.243412 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:12:00.243117 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:12:14.242202 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:12:14.242136 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:12:14.242589 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:12:14.242304 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:12:29.244553 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:12:29.244520 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:12:29.245024 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:12:29.244772 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:12:41.242949 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:12:41.242919 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:12:41.243390 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:12:41.243091 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:12:55.242251 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:12:55.242222 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:12:55.242872 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:12:55.242400 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:13:08.242564 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:08.242533 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:13:08.243010 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:13:08.242724 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:13:19.246093 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:19.246061 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:13:19.246669 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:13:19.246286 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:13:32.242755 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:32.242727 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:13:33.604660 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:33.604622 2558 generic.go:356] "Generic (PLEG): container finished" podID="9d127492-4734-46ab-bc02-f03642552868" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" exitCode=1 Jul 27 17:13:33.605060 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:33.604689 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" event={"ID":"9d127492-4734-46ab-bc02-f03642552868","Type":"ContainerDied","Data":"5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35"} Jul 27 17:13:33.605060 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:33.604751 2558 scope.go:117] "RemoveContainer" containerID="d847859ef3bb3fa57405316dd6cdd9666c30d849806d326da0e63e5efc35e2fd" Jul 27 17:13:33.605060 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:33.605056 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:13:33.605299 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:13:33.605275 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:13:35.880017 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:35.879991 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:13:35.880372 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:35.880267 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:13:35.880428 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:13:35.880410 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:13:43.456031 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:43.455940 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" Jul 27 17:13:43.456487 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:43.456361 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:13:43.456612 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:13:43.456586 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:13:56.242284 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:13:56.242247 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:13:56.242814 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:13:56.242497 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:14:09.244205 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:14:09.244175 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:14:09.244680 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:14:09.244359 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:14:20.242603 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:14:20.242573 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:14:20.243055 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:14:20.242756 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:14:33.242396 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:14:33.242355 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:14:33.242913 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:14:33.242649 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:14:45.242643 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:14:45.242603 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:14:45.243144 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:14:45.242852 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:14:59.244650 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:14:59.244616 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:14:59.245110 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:14:59.244835 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:15:11.242883 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:15:11.242808 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:15:11.243399 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:15:11.242992 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:15:19.225225 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:15:19.225187 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:15:19.226798 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:15:19.226777 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:15:22.242843 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:15:22.242814 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:15:22.243225 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:15:22.242989 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:15:36.242728 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:15:36.242701 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:15:36.243104 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:15:36.242876 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:15:42.390706 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:15:42.390663 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-pk9f8" podUID="9cb9335e-07d6-4137-9f3a-51fb0413751f" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 17:15:42.393177 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:15:42.390786 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:15:42.393177 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:15:42.391375 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-pk9f8" podUID="9cb9335e-07d6-4137-9f3a-51fb0413751f" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 27 17:15:51.242618 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:15:51.242592 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:15:51.243053 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:15:51.242754 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:16:04.242247 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:16:04.242221 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:16:04.242711 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:16:04.242382 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:16:12.392559 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:16:12.392528 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pk9f8" Jul 27 17:16:16.242554 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:16:16.242491 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:16:16.242987 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:16:16.242718 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:16:27.242356 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:16:27.242319 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:16:27.242911 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:16:27.242633 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:16:42.242913 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:16:42.242828 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:16:42.243378 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:16:42.243011 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:16:57.242960 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:16:57.242930 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:16:57.243437 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:16:57.243119 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:17:10.242434 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:17:10.242403 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:17:10.242901 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:17:10.242642 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:17:22.242382 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:17:22.242350 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:17:22.242912 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:17:22.242596 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:17:29.628101 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:17:29.628065 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-gk8nx_9d127492-4734-46ab-bc02-f03642552868/manager/6.log" Jul 27 17:17:35.242439 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:17:35.242406 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:17:35.242951 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:17:35.242592 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:17:46.242821 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:17:46.242786 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:17:46.243297 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:17:46.242979 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:17:57.519421 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:17:57.519392 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m8xpw_e726e51d-787e-4b3f-b003-ad105dd69b3e/global-pull-secret-syncer/0.log" Jul 27 17:17:57.630493 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:17:57.630466 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pk9f8_9cb9335e-07d6-4137-9f3a-51fb0413751f/konnectivity-agent/0.log" Jul 27 17:17:57.695686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:17:57.695656 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-73.ec2.internal_2765500e3b6ee453220e06c841f29167/haproxy/0.log" Jul 27 17:18:01.242905 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:01.242878 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:18:01.243303 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:18:01.243087 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:18:01.958930 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:01.958898 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-f95gb_beafa525-e855-4bb3-8b86-d93611b2f2c1/cluster-monitoring-operator/0.log" Jul 27 17:18:02.125040 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:02.125007 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dglc_7c31d39a-acec-4afd-85f2-9d6f082a9a2d/node-exporter/0.log" Jul 27 17:18:02.146133 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:02.146088 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dglc_7c31d39a-acec-4afd-85f2-9d6f082a9a2d/kube-rbac-proxy/0.log" Jul 27 17:18:02.174465 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:02.174434 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dglc_7c31d39a-acec-4afd-85f2-9d6f082a9a2d/init-textfile/0.log" Jul 27 17:18:04.747775 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:04.747739 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/2.log" Jul 27 17:18:04.752469 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:04.752453 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-6xlxh_74763785-12fb-4fe1-9f3f-d0d18ff33ecb/console-operator/3.log" Jul 27 17:18:05.187371 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:05.187343 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d7b85f6bf-lz4dg_aeb36aea-30b0-4f1f-bf98-ef69d1ad2e35/console/0.log" Jul 27 17:18:05.751955 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:05.751923 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-7cpbt_eb3a8bb5-ec0f-4fd2-a269-6e27cde15c45/volume-data-source-validator/0.log" Jul 27 17:18:06.399191 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.399154 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp"] Jul 27 17:18:06.399478 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.399466 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e563feeb-864b-455c-8bde-969be3194d8c" containerName="console" Jul 27 17:18:06.399551 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.399480 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e563feeb-864b-455c-8bde-969be3194d8c" containerName="console" Jul 27 17:18:06.399587 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.399552 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e563feeb-864b-455c-8bde-969be3194d8c" containerName="console" Jul 27 17:18:06.402401 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.402384 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.405247 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.405223 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxdlg\"/\"openshift-service-ca.crt\"" Jul 27 17:18:06.405247 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.405225 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxdlg\"/\"kube-root-ca.crt\"" Jul 27 17:18:06.406274 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.406246 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mxdlg\"/\"default-dockercfg-6jsjk\"" Jul 27 17:18:06.410612 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.410589 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp"] Jul 27 17:18:06.461593 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.461551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-lib-modules\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.461593 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.461591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csdfm\" (UniqueName: \"kubernetes.io/projected/58feab65-0a8d-4853-94da-e81285ff455d-kube-api-access-csdfm\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.461830 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.461615 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-sys\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.461830 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.461633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-proc\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.461830 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.461723 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-podres\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.563088 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.563040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-lib-modules\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.563088 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.563084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csdfm\" (UniqueName: \"kubernetes.io/projected/58feab65-0a8d-4853-94da-e81285ff455d-kube-api-access-csdfm\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.563320 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.563105 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-sys\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.563320 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.563169 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-sys\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.563320 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.563212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-proc\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.563320 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.563217 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-lib-modules\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.563320 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.563274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-podres\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.563320 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.563277 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-proc\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.563560 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.563366 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58feab65-0a8d-4853-94da-e81285ff455d-podres\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.571977 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.571942 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csdfm\" (UniqueName: \"kubernetes.io/projected/58feab65-0a8d-4853-94da-e81285ff455d-kube-api-access-csdfm\") pod \"perf-node-gather-daemonset-ntvkp\" (UID: \"58feab65-0a8d-4853-94da-e81285ff455d\") " pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.714557 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.714435 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:06.767961 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.767939 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9v8v_1b1a7361-fe70-4825-82c5-28abfce0499a/dns/0.log" Jul 27 17:18:06.796541 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.796488 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x9v8v_1b1a7361-fe70-4825-82c5-28abfce0499a/kube-rbac-proxy/0.log" Jul 27 17:18:06.849283 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.849246 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r6s2z_2e47f535-d51d-4a76-a64d-0fe4d83316fa/dns-node-resolver/0.log" Jul 27 17:18:06.853325 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:06.853303 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp"] Jul 27 17:18:06.855526 ip-10-0-140-73 kubenswrapper[2558]: W0727 17:18:06.855484 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod58feab65_0a8d_4853_94da_e81285ff455d.slice/crio-c7c5a1cc5586b964bf6b6f0e41fc7ed9cc3342d01334393064239fea9608c810 WatchSource:0}: Error finding container c7c5a1cc5586b964bf6b6f0e41fc7ed9cc3342d01334393064239fea9608c810: Status 404 returned error can't find the container with id c7c5a1cc5586b964bf6b6f0e41fc7ed9cc3342d01334393064239fea9608c810 Jul 27 17:18:07.350027 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:07.349999 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k9z9x_c0e3a68f-bcfd-4f6a-9663-a60146e7b64a/node-ca/0.log" Jul 27 17:18:07.758136 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:07.758041 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" event={"ID":"58feab65-0a8d-4853-94da-e81285ff455d","Type":"ContainerStarted","Data":"dc4e68917362380bcb9af745041f3f3070b9df6064314d824d5b89ce33dde69d"} Jul 27 17:18:07.758136 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:07.758119 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" event={"ID":"58feab65-0a8d-4853-94da-e81285ff455d","Type":"ContainerStarted","Data":"c7c5a1cc5586b964bf6b6f0e41fc7ed9cc3342d01334393064239fea9608c810"} Jul 27 17:18:07.758345 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:07.758189 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:07.778574 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:07.778519 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" podStartSLOduration=1.778483984 podStartE2EDuration="1.778483984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 17:18:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 17:18:07.777450352 +0000 UTC m=+1069.026086839" watchObservedRunningTime="2026-07-27 17:18:07.778483984 +0000 UTC m=+1069.027120503" Jul 27 17:18:08.166909 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:08.166882 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54886598f-4vhvf_55886cbf-490e-45fb-9a50-ba190b8b3f15/router/0.log" Jul 27 17:18:08.516380 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:08.516350 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7nw2w_0ba6b380-8f10-4576-a94c-b351da05a1fd/serve-healthcheck-canary/0.log" Jul 27 17:18:08.905164 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:08.905083 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-hbw96_ffa39d2c-ea50-4534-849f-c7a48af88694/insights-operator/1.log" Jul 27 17:18:08.910894 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:08.910870 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-hbw96_ffa39d2c-ea50-4534-849f-c7a48af88694/insights-operator/0.log" Jul 27 17:18:08.932728 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:08.932700 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cj8v2_9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e/kube-rbac-proxy/0.log" Jul 27 17:18:08.959398 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:08.959372 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cj8v2_9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e/exporter/0.log" Jul 27 17:18:08.985734 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:08.985705 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cj8v2_9a2a5c1e-e06e-4c40-9f2b-90a08927ba0e/extractor/0.log" Jul 27 17:18:11.374007 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:11.373928 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-gk8nx_9d127492-4734-46ab-bc02-f03642552868/manager/6.log" Jul 27 17:18:11.374007 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:11.373931 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-gk8nx_9d127492-4734-46ab-bc02-f03642552868/manager/6.log" Jul 27 17:18:13.772733 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:13.772704 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mxdlg/perf-node-gather-daemonset-ntvkp" Jul 27 17:18:15.691910 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:15.691874 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj_592d9913-e610-4245-9cea-5d505993746e/kube-storage-version-migrator-operator/1.log" Jul 27 17:18:15.692853 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:15.692837 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-cvftj_592d9913-e610-4245-9cea-5d505993746e/kube-storage-version-migrator-operator/0.log" Jul 27 17:18:16.242125 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:16.242090 2558 scope.go:117] "RemoveContainer" containerID="5d7dc740195c772f0d025bf523d56ec36eaf344fc2de5593e548a6fbec547e35" Jul 27 17:18:16.242300 ip-10-0-140-73 kubenswrapper[2558]: E0727 17:18:16.242279 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-gk8nx_kserve(9d127492-4734-46ab-bc02-f03642552868)\"" pod="kserve/llmisvc-controller-manager-654c557856-gk8nx" podUID="9d127492-4734-46ab-bc02-f03642552868" Jul 27 17:18:16.686255 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:16.686227 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cg26_3155d2f3-4f29-4286-822a-c219199aa133/kube-multus-additional-cni-plugins/0.log" Jul 27 17:18:16.708270 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:16.708240 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cg26_3155d2f3-4f29-4286-822a-c219199aa133/egress-router-binary-copy/0.log" Jul 27 17:18:16.731374 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:16.731344 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cg26_3155d2f3-4f29-4286-822a-c219199aa133/cni-plugins/0.log" Jul 27 17:18:16.754398 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:16.754374 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cg26_3155d2f3-4f29-4286-822a-c219199aa133/bond-cni-plugin/0.log" Jul 27 17:18:16.777686 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:16.777661 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cg26_3155d2f3-4f29-4286-822a-c219199aa133/routeoverride-cni/0.log" Jul 27 17:18:16.798474 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:16.798447 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cg26_3155d2f3-4f29-4286-822a-c219199aa133/whereabouts-cni-bincopy/0.log" Jul 27 17:18:16.819620 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:16.819594 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cg26_3155d2f3-4f29-4286-822a-c219199aa133/whereabouts-cni/0.log" Jul 27 17:18:17.244973 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:17.244943 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zpjxn_c32310eb-1b04-49f8-b512-e509d8f2d862/kube-multus/0.log" Jul 27 17:18:17.374974 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:17.374943 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sv2m2_86b8c493-d5fc-44f8-9aba-1a30e8f2a82b/network-metrics-daemon/0.log" Jul 27 17:18:17.397026 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:17.396997 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sv2m2_86b8c493-d5fc-44f8-9aba-1a30e8f2a82b/kube-rbac-proxy/0.log" Jul 27 17:18:18.577035 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:18.577008 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccmz8_3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6/ovn-controller/0.log" Jul 27 17:18:18.594866 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:18.594841 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccmz8_3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6/ovn-acl-logging/0.log" Jul 27 17:18:18.619720 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:18.619687 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccmz8_3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6/kube-rbac-proxy-node/0.log" Jul 27 17:18:18.638060 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:18.638030 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccmz8_3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6/kube-rbac-proxy-ovn-metrics/0.log" Jul 27 17:18:18.657031 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:18.657002 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccmz8_3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6/northd/0.log" Jul 27 17:18:18.677164 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:18.677142 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccmz8_3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6/nbdb/0.log" Jul 27 17:18:18.697735 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:18.697706 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccmz8_3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6/sbdb/0.log" Jul 27 17:18:18.736107 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:18.736071 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ccmz8_3fa51bf0-cb15-4a82-99a7-d6b95ee9c6a6/ovnkube-controller/0.log" Jul 27 17:18:19.725945 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:19.725899 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-fzxxj_0cf5db6e-8a9f-4bed-bca3-873abc56cf26/network-check-target-container/0.log" Jul 27 17:18:20.620079 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:20.620049 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dbqn7_4ae0702f-a822-42b0-804b-074533de56f6/iptables-alerter/0.log" Jul 27 17:18:21.289680 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:21.289650 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hsfg8_b9347cd5-f0c6-452e-8506-9c8ccb162e67/tuned/0.log" Jul 27 17:18:22.994407 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:22.994373 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-qljqz_d9742883-9cdb-4a8f-98bf-cc8fef7f070c/cluster-samples-operator/0.log" Jul 27 17:18:23.009267 ip-10-0-140-73 kubenswrapper[2558]: I0727 17:18:23.009230 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-qljqz_d9742883-9cdb-4a8f-98bf-cc8fef7f070c/cluster-samples-operator-watch/0.log"