Jul 29 16:50:56.888359 ip-10-0-132-134 systemd[1]: Starting Kubernetes Kubelet... Jul 29 16:50:57.359613 ip-10-0-132-134 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 16:50:57.359613 ip-10-0-132-134 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 16:50:57.359613 ip-10-0-132-134 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 16:50:57.359613 ip-10-0-132-134 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 16:50:57.359613 ip-10-0-132-134 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 16:50:57.362985 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.362879 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 16:50:57.367802 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367788 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:57.367802 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367801 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367805 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367809 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367812 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367816 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367819 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367822 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367826 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367830 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367834 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367837 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367845 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367848 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367851 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367854 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367857 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367859 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367862 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367865 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367867 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:57.367863 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367870 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367873 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367876 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367879 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367881 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367884 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367886 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367889 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367891 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367894 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367896 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367899 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367901 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367904 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367906 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367908 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367912 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367916 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367919 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367921 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:57.368384 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367924 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367927 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367929 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367931 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367934 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367936 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367939 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367941 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367943 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367946 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367950 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367953 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367956 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367958 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367962 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367964 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367967 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367970 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367972 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:57.368869 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367975 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367978 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367980 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367983 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367985 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367988 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367990 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367993 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367995 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.367998 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368000 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368003 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368006 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368008 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368010 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368013 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368016 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368020 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368024 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368026 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:57.369350 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368029 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368032 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368035 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368037 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368040 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368043 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368058 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368062 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368066 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368069 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368072 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368074 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368077 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368079 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368082 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368085 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368087 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368090 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.368093 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369617 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:57.369826 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369624 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369627 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369630 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369633 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369637 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369640 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369643 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369645 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369648 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369651 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369653 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369656 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369658 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369661 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369665 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369669 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369672 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369675 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369677 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369681 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:57.370323 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369684 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369687 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369690 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369692 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369695 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369699 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369702 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369705 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369708 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369710 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369713 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369716 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369719 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369722 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369724 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369727 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369730 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369733 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369736 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369738 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:57.370809 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369741 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369743 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369746 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369748 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369751 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369753 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369756 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369758 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369760 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369764 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369766 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369769 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369772 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369774 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369777 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369780 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369782 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369785 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369787 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:57.371312 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369790 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369792 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369795 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369797 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369799 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369802 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369805 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369808 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369810 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369813 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369815 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369818 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369820 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369823 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369825 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369828 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369830 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369833 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369836 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369838 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:57.371787 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369841 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369843 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369846 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369849 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369852 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369854 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369857 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369859 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369862 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369865 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369867 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369870 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369872 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369874 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369877 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369881 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369884 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369887 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.369890 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:57.372295 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370258 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370263 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370266 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370269 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370272 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370275 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370278 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370281 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370283 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370286 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370289 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370291 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370294 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370297 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370299 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370302 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370305 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370308 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370311 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370313 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:57.372753 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370316 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370318 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370321 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370323 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370326 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370329 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370332 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370334 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370337 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370340 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370342 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370345 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370348 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370350 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370352 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370355 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370358 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370360 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370363 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370366 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:57.373257 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370368 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370370 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370373 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370375 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370378 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370380 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370383 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370385 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370388 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370391 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370394 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370396 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370399 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370401 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370404 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370406 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370409 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370411 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370415 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:57.373788 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370418 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370422 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370424 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370427 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370430 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370432 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370435 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370437 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370441 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370445 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370448 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370451 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370454 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370457 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370460 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370462 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370466 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370469 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370472 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:57.374262 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370475 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370478 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370481 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370484 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370487 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370489 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370492 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370495 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370498 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370500 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370503 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370506 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370509 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370511 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370514 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370516 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370519 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370522 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370524 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370526 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.370529 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:57.374729 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370592 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370598 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370604 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370610 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370616 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370622 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370627 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370633 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370637 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370640 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370644 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370647 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370650 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370653 2556 flags.go:64] FLAG: --cgroup-root="" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370656 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370659 2556 flags.go:64] FLAG: --client-ca-file="" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370662 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370665 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370669 2556 flags.go:64] FLAG: --cluster-domain="" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370673 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370676 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370679 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370682 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370685 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 16:50:57.375292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370688 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370691 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370695 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370698 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370700 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370703 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370706 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370709 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370713 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370716 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370719 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370721 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370724 2556 flags.go:64] FLAG: --enable-server="true" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370728 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370732 2556 flags.go:64] FLAG: --event-burst="100" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370735 2556 flags.go:64] FLAG: --event-qps="50" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370737 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370741 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370744 2556 flags.go:64] FLAG: --eviction-hard="" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370747 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370750 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370753 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370756 2556 flags.go:64] FLAG: --eviction-soft="" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370759 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370761 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 16:50:57.375875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370764 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370767 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370770 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370773 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370776 2556 flags.go:64] FLAG: --feature-gates="" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370779 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370782 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370785 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370788 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370791 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370794 2556 flags.go:64] FLAG: --help="false" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370797 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370799 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370802 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370805 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370809 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370812 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370815 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370820 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370823 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370826 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370829 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370833 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370835 2556 flags.go:64] FLAG: --kube-reserved="" Jul 29 16:50:57.376511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370838 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370841 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370844 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370848 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370851 2556 flags.go:64] FLAG: --lock-file="" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370854 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370857 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370860 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370865 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370868 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370871 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370874 2556 flags.go:64] FLAG: --logging-format="text" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370877 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370880 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370883 2556 flags.go:64] FLAG: --manifest-url="" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370886 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370890 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370893 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370897 2556 flags.go:64] FLAG: --max-pods="110" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370900 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370903 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370905 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370908 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370911 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370914 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 16:50:57.377122 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370917 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370925 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370928 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370931 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370934 2556 flags.go:64] FLAG: --pod-cidr="" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370938 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370943 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370946 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370949 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370952 2556 flags.go:64] FLAG: --port="10250" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370957 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370960 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02a5da95414ac2385" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370963 2556 flags.go:64] FLAG: --qos-reserved="" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370966 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370969 2556 flags.go:64] FLAG: --register-node="true" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370972 2556 flags.go:64] FLAG: --register-with-taints="" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370976 2556 flags.go:64] FLAG: --registry-burst="10" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370978 2556 flags.go:64] FLAG: --registry-qps="5" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370981 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370984 2556 flags.go:64] FLAG: --reserved-memory="" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370987 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370990 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370993 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370996 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.370999 2556 flags.go:64] FLAG: --runonce="false" Jul 29 16:50:57.377757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371001 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371004 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371007 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371010 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371012 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371015 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371018 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371021 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371024 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371028 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371031 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371034 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371037 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371041 2556 flags.go:64] FLAG: --system-cgroups="" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371043 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371061 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371064 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371068 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371072 2556 flags.go:64] FLAG: --tls-min-version="" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371075 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371077 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371080 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371083 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371086 2556 flags.go:64] FLAG: --v="2" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371089 2556 flags.go:64] FLAG: --version="false" Jul 29 16:50:57.378403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371094 2556 flags.go:64] FLAG: --vmodule="" Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371097 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.371100 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371247 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371252 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371255 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371259 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371262 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371265 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371268 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371271 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371274 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371276 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371279 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371282 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371284 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371288 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371291 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371293 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371296 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:57.379044 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371298 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371306 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371309 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371312 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371317 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371320 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371322 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371325 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371328 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371330 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371333 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371335 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371338 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371340 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371343 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371346 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371348 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371351 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371353 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:57.379541 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371356 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371359 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371361 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371364 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371366 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371369 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371373 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371377 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371380 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371384 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371387 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371389 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371392 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371394 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371397 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371407 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371409 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371413 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371416 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:57.380004 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371418 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371421 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371423 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371426 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371428 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371431 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371433 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371436 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371438 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371441 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371443 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371446 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371449 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371451 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371453 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371456 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371458 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371461 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371463 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371466 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371468 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:57.380501 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371470 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371474 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371477 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371479 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371483 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371487 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371489 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371492 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371500 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371504 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371507 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371509 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371513 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371517 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371519 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371522 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371525 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371527 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:57.381418 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371530 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371532 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371534 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371537 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.371539 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.372671 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.379815 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.379832 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.379851 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.379859 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379919 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379925 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379929 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379933 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:57.382094 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379938 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379941 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379944 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379946 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379949 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379952 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379955 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379957 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379960 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379962 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379965 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379967 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379970 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379972 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379975 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379978 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379980 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379983 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379986 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379988 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379991 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:57.382450 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379993 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379996 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.379999 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380002 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380011 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380014 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380017 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380020 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380022 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380025 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380027 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380030 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380032 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380038 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380041 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380044 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380061 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380065 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380069 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:57.382961 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380073 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380076 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380079 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380082 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380085 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380088 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380091 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380093 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380096 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380098 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380101 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380103 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380106 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380109 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380111 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380114 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380117 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380121 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380133 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380137 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:57.383429 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380140 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380143 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380146 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380149 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380151 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380154 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380157 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380159 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380161 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380164 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380167 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380169 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380172 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380174 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380177 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380179 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380182 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380184 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380187 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380189 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:57.383921 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380191 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380194 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380197 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380199 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380202 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380205 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380207 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380210 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380212 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380215 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380218 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380227 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380230 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380233 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380235 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:57.384471 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.380240 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.380508 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381413 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381421 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381427 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381435 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381440 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381497 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381721 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381727 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381730 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381734 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381736 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381740 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381745 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381749 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381751 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381754 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381757 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:57.384872 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381759 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381762 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381765 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381767 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381770 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381773 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381776 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381778 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381781 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381783 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381787 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381791 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381794 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381797 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381800 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381803 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381807 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381812 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381815 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:57.385466 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381818 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381821 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381823 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381826 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381828 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381831 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381833 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381836 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381838 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381841 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381844 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381846 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381849 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381852 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381855 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381857 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381860 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381862 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381865 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381868 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:57.385916 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381871 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381873 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381876 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381878 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381881 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381883 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381886 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381888 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381891 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381894 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381897 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381900 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381902 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381905 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381907 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381910 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381912 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381915 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381917 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381920 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:57.386442 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381922 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381927 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381930 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381932 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381937 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381939 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381942 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381944 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381947 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381949 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381952 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381955 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381957 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381960 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381962 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381965 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381967 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381970 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381972 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381975 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:57.386920 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381977 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:57.387412 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:57.381980 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:57.387412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.381986 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 16:50:57.387412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.382114 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 16:50:57.387412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.384030 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 16:50:57.387412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.385459 2556 server.go:1019] "Starting client certificate rotation" Jul 29 16:50:57.387412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.385553 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 16:50:57.387412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.385588 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 16:50:57.388153 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.388140 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 16:50:57.389327 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.389311 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 16:50:57.398633 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.398618 2556 log.go:25] "Validated CRI v1 runtime API" Jul 29 16:50:57.401412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.401397 2556 log.go:25] "Validated CRI v1 image API" Jul 29 16:50:57.402161 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.402144 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 16:50:57.405336 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.405318 2556 fs.go:135] Filesystem UUIDs: map[5723de60-26d1-4819-8201-6ab2b3d4e0a9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7d562201-1d8b-4fdc-b093-2f16d581c700:/dev/nvme0n1p3] Jul 29 16:50:57.405397 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.405335 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 16:50:57.411577 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.411472 2556 manager.go:216] Machine: {Timestamp:2026-07-29 16:50:57.409945548 +0000 UTC m=+0.373018438 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100973 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c3faf3165d9ed2c52211a1c129a05 SystemUUID:ec2c3faf-3165-d9ed-2c52-211a1c129a05 BootID:b3d312ee-1221-4244-b7af-2c7152d627a3 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:dd:23:43:a3:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:dd:23:43:a3:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:09:4e:46:bf:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 16:50:57.411577 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.411572 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 16:50:57.411694 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.411663 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 16:50:57.415037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.415011 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 16:50:57.415250 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.415039 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-134.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 16:50:57.415967 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.415955 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 16:50:57.416014 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.415969 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 16:50:57.416014 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.415976 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 16:50:57.416014 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.415994 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 16:50:57.417253 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.417241 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 16:50:57.418843 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.418828 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 16:50:57.419842 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.419830 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 29 16:50:57.419963 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.419953 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 16:50:57.420003 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.419984 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 29 16:50:57.420003 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.419995 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 16:50:57.420094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.420023 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 16:50:57.420094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.420083 2556 kubelet.go:398] "Adding apiserver pod source" Jul 29 16:50:57.420145 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.420115 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 16:50:57.420556 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.420544 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 16:50:57.420600 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.420569 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 16:50:57.424009 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.423953 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 16:50:57.425611 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.425595 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 16:50:57.425672 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.425626 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 16:50:57.426837 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426821 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 16:50:57.426888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426844 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 16:50:57.426888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426853 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 16:50:57.426888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426858 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 16:50:57.426888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426867 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 16:50:57.426888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426872 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 16:50:57.426888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426879 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 16:50:57.426888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426884 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 16:50:57.426888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426890 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 16:50:57.427116 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426895 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 16:50:57.427116 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426904 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 16:50:57.427116 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.426908 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 16:50:57.427905 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.427895 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 16:50:57.427905 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.427904 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 16:50:57.431509 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.431494 2556 server.go:1268] "Started kubelet" Jul 29 16:50:57.431631 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.431576 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 16:50:57.431869 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.431585 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 16:50:57.431869 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.431837 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 16:50:57.432319 ip-10-0-132-134 systemd[1]: Started Kubernetes Kubelet. Jul 29 16:50:57.433169 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.433146 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 16:50:57.433232 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.433204 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-134.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 16:50:57.433288 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.433232 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 16:50:57.433954 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.433941 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 16:50:57.434407 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.434395 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 29 16:50:57.437114 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.437086 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 16:50:57.438146 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.436979 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-134.ec2.internal.18c6d0c77820c435 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-134.ec2.internal,UID:ip-10-0-132-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-134.ec2.internal,},FirstTimestamp:2026-07-29 16:50:57.431462965 +0000 UTC m=+0.394535854,LastTimestamp:2026-07-29 16:50:57.431462965 +0000 UTC m=+0.394535854,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-134.ec2.internal,}" Jul 29 16:50:57.439183 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.439165 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 16:50:57.439183 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.439182 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 16:50:57.439356 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.439336 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:57.439863 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.439849 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 16:50:57.439966 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.439851 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 16:50:57.440024 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440018 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 16:50:57.440124 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440100 2556 factory.go:55] Registering systemd factory Jul 29 16:50:57.440273 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440253 2556 factory.go:223] Registration of the systemd container factory successfully Jul 29 16:50:57.440378 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440211 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 29 16:50:57.440378 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440308 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 29 16:50:57.440540 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440466 2556 factory.go:153] Registering CRI-O factory Jul 29 16:50:57.440540 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440478 2556 factory.go:223] Registration of the crio container factory successfully Jul 29 16:50:57.440540 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440537 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 16:50:57.440678 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440555 2556 factory.go:103] Registering Raw factory Jul 29 16:50:57.440678 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.440565 2556 manager.go:1196] Started watching for new ooms in manager Jul 29 16:50:57.441158 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.441143 2556 manager.go:349] Starting recovery of all containers Jul 29 16:50:57.452811 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.452775 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-134.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 16:50:57.452811 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.452794 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 16:50:57.454576 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.454560 2556 manager.go:354] Recovery completed Jul 29 16:50:57.455748 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.455733 2556 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 29 16:50:57.458699 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.458687 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:57.460715 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.460700 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:57.460761 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.460727 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:57.460761 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.460737 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:57.461224 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.461211 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 16:50:57.461224 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.461224 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 16:50:57.461344 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.461227 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:57.461344 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.461240 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 29 16:50:57.462696 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.462684 2556 policy_none.go:49] "None policy: Start" Jul 29 16:50:57.462760 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.462701 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 16:50:57.462760 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.462715 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 16:50:57.463208 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.463194 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:57.463278 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.463219 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:57.463278 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.463232 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:57.463612 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.463600 2556 policy_none.go:47] "Start" Jul 29 16:50:57.468563 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.468468 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nzmmb" Jul 29 16:50:57.470106 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.470020 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-134.ec2.internal.18c6d0c779df1ea5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-134.ec2.internal,UID:ip-10-0-132-134.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-134.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-134.ec2.internal,},FirstTimestamp:2026-07-29 16:50:57.460715173 +0000 UTC m=+0.423788062,LastTimestamp:2026-07-29 16:50:57.460715173 +0000 UTC m=+0.423788062,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-134.ec2.internal,}" Jul 29 16:50:57.476149 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.476128 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nzmmb" Jul 29 16:50:57.497572 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.497558 2556 manager.go:337] "Starting Device Plugin manager" Jul 29 16:50:57.497659 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.497590 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 16:50:57.497659 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.497602 2556 server.go:87] "Starting device plugin registration server" Jul 29 16:50:57.497829 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.497817 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 16:50:57.497888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.497830 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 16:50:57.497933 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.497923 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 16:50:57.498021 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.498006 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 16:50:57.498021 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.498019 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 16:50:57.498491 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.498472 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 16:50:57.498578 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.498513 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:57.526370 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.526343 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 16:50:57.536400 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.527533 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 16:50:57.536400 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.527579 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 16:50:57.536400 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.527601 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 16:50:57.536400 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.527637 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 16:50:57.536400 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.529869 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:57.598091 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.598032 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:57.598918 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.598901 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:57.598985 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.598932 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:57.598985 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.598942 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:57.598985 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.598967 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.608315 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.608297 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.608387 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.608319 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-134.ec2.internal\": node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:57.627960 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.627915 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal"] Jul 29 16:50:57.628012 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.627970 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:57.629262 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.629248 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:57.629319 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.629276 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:57.629319 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.629285 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:57.631482 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.631469 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:57.631592 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.631579 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.631648 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.631607 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:57.632220 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.632204 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:57.632314 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.632232 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:57.632314 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.632248 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:57.632314 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.632206 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:57.632314 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.632310 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:57.632504 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.632321 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:57.634485 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.634468 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.634567 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.634499 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:57.635171 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.635150 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:57.635248 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.635186 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:57.635248 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.635202 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:57.637683 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.637660 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:57.641458 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.641439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51238a16678a7e2ea17ddbdcf5c3bea4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-134.ec2.internal\" (UID: \"51238a16678a7e2ea17ddbdcf5c3bea4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.641552 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.641472 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/682d0f3c94b790b049ee686bf8f84b61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"682d0f3c94b790b049ee686bf8f84b61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.641552 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.641499 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/682d0f3c94b790b049ee686bf8f84b61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"682d0f3c94b790b049ee686bf8f84b61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.660847 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.660831 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-134.ec2.internal\" not found" node="ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.665479 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.665463 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-134.ec2.internal\" not found" node="ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.738621 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.738598 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:57.742091 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.742074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51238a16678a7e2ea17ddbdcf5c3bea4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-134.ec2.internal\" (UID: \"51238a16678a7e2ea17ddbdcf5c3bea4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.742176 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.742100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/682d0f3c94b790b049ee686bf8f84b61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"682d0f3c94b790b049ee686bf8f84b61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.742176 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.742119 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/682d0f3c94b790b049ee686bf8f84b61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"682d0f3c94b790b049ee686bf8f84b61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.742176 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.742160 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51238a16678a7e2ea17ddbdcf5c3bea4-config\") pod \"kube-apiserver-proxy-ip-10-0-132-134.ec2.internal\" (UID: \"51238a16678a7e2ea17ddbdcf5c3bea4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.742280 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.742207 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/682d0f3c94b790b049ee686bf8f84b61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"682d0f3c94b790b049ee686bf8f84b61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.742280 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.742228 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/682d0f3c94b790b049ee686bf8f84b61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal\" (UID: \"682d0f3c94b790b049ee686bf8f84b61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.845584 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.845538 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:57.946426 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:57.946341 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:57.964481 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.964455 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 29 16:50:57.968865 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:57.968846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 29 16:50:58.046765 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:58.046729 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:58.147730 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:58.147692 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:58.248583 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:58.248492 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:58.349293 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:58.349258 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:58.385555 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.385528 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 16:50:58.386013 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.385698 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 16:50:58.449538 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:58.449508 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-134.ec2.internal\" not found" Jul 29 16:50:58.477855 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.477809 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 16:45:57 +0000 UTC" deadline="2028-04-15 06:26:10.13413601 +0000 UTC" Jul 29 16:50:58.477855 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.477850 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15013h35m11.656290339s" Jul 29 16:50:58.491147 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.491108 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:58.493215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.493177 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:58.493215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.493218 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:58.493394 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.493234 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:58.513804 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.513733 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:58.540212 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.540186 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" Jul 29 16:50:58.550988 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.550962 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 16:50:58.553414 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.553393 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" Jul 29 16:50:58.567189 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.567168 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 16:50:58.569534 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:58.569505 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod682d0f3c94b790b049ee686bf8f84b61.slice/crio-ce8c7e39a6b014ff869f23004883f0e872fff3a7e5f5f0a145bb2318c1ad8627 WatchSource:0}: Error finding container ce8c7e39a6b014ff869f23004883f0e872fff3a7e5f5f0a145bb2318c1ad8627: Status 404 returned error can't find the container with id ce8c7e39a6b014ff869f23004883f0e872fff3a7e5f5f0a145bb2318c1ad8627 Jul 29 16:50:58.575559 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:58.575511 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51238a16678a7e2ea17ddbdcf5c3bea4.slice/crio-60b03196ee92c63945df95bfda1dd9aa7be6e675e7b74d0855169e352ce22ba2 WatchSource:0}: Error finding container 60b03196ee92c63945df95bfda1dd9aa7be6e675e7b74d0855169e352ce22ba2: Status 404 returned error can't find the container with id 60b03196ee92c63945df95bfda1dd9aa7be6e675e7b74d0855169e352ce22ba2 Jul 29 16:50:58.575994 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.575976 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 16:50:58.735253 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.735224 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:58.790740 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:58.790659 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:59.421492 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.421458 2556 apiserver.go:52] "Watching apiserver" Jul 29 16:50:59.429631 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.429610 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 16:50:59.430017 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.429993 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9","openshift-cluster-node-tuning-operator/tuned-4vlzj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal","openshift-multus/network-metrics-daemon-s29ts","openshift-ovn-kubernetes/ovnkube-node-v9xpq","kube-system/global-pull-secret-syncer-77lxz","openshift-dns/node-resolver-ld22h","openshift-image-registry/node-ca-8n58r","openshift-multus/multus-7wmfd","openshift-multus/multus-additional-cni-plugins-w22hn","openshift-network-diagnostics/network-check-target-dng5h","openshift-network-operator/iptables-alerter-xlsrv","kube-system/konnectivity-agent-kdkxp","kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal"] Jul 29 16:50:59.434105 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.434084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.436597 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.436572 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 16:50:59.436699 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.436594 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w7zft\"" Jul 29 16:50:59.436699 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.436609 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 16:50:59.436699 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.436604 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.436874 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.436853 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 16:50:59.438976 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.438958 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:50:59.439068 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.439017 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:50:59.439715 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.439692 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:50:59.439894 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.439876 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l9nlt\"" Jul 29 16:50:59.439973 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.439965 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 16:50:59.440261 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.440243 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 16:50:59.441423 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.441404 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.443643 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.443623 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 16:50:59.443797 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.443623 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rnlns\"" Jul 29 16:50:59.443797 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.443745 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:50:59.443797 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.443755 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 16:50:59.443967 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.443821 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 16:50:59.443967 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.443824 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:50:59.443967 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.443871 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 16:50:59.444177 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.444026 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 16:50:59.444736 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.444716 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 16:50:59.446233 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.446215 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.448641 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.448624 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.448903 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.448885 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 16:50:59.449152 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.449120 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rglgv\"" Jul 29 16:50:59.449373 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.449359 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 16:50:59.450971 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.450938 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 16:50:59.451033 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.451004 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 16:50:59.451184 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.451167 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kgfgv\"" Jul 29 16:50:59.451243 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.451186 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.451894 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.451764 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 16:50:59.454252 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.454221 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.455859 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.455831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-host\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.455948 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.455892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8qnh\" (UniqueName: \"kubernetes.io/projected/79474e7f-abba-4a5d-bdcb-8e1da121782e-kube-api-access-r8qnh\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.455948 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.455923 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-kubelet\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456022 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.455949 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-run-openvswitch\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456022 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.455975 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.456022 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-systemd\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.456137 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-sys\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.456137 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456042 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-tuned\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.456137 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456064 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-log-socket\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456137 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456088 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-cni-netd\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456137 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456112 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-registration-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.456291 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456160 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-modprobe-d\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.456291 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-sysconfig\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.456291 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456205 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:50:59.456291 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-slash\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-run-systemd\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456316 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-node-log\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456332 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51575911-62f1-48d9-a23e-35ca1fb96855-ovnkube-config\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456348 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51575911-62f1-48d9-a23e-35ca1fb96855-ovn-node-metrics-cert\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-device-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.456430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456391 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-systemd-units\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-run-netns\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456419 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-run-ovn\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456434 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456469 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-lib-modules\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51575911-62f1-48d9-a23e-35ca1fb96855-env-overrides\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456524 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-socket-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456549 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsnvn\" (UniqueName: \"kubernetes.io/projected/ad2a8adc-3589-44a3-881b-155ea51373e9-kube-api-access-jsnvn\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-sysctl-d\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-sysctl-conf\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456627 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79474e7f-abba-4a5d-bdcb-8e1da121782e-tmp\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456653 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8tdx\" (UniqueName: \"kubernetes.io/projected/1da775fc-ac1d-4a60-89cc-c18daa86454c-kube-api-access-s8tdx\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:50:59.456701 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-etc-openvswitch\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg47x\" (UniqueName: \"kubernetes.io/projected/51575911-62f1-48d9-a23e-35ca1fb96855-kube-api-access-dg47x\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456773 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-kubernetes\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456812 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-sys-fs\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-var-lib-kubelet\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456901 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-var-lib-openvswitch\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456920 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-cni-bin\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51575911-62f1-48d9-a23e-35ca1fb96855-ovnkube-script-lib\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.457089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.456951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-run\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.457637 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.457200 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:50:59.457637 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.457254 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:50:59.457950 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.457928 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 16:50:59.458047 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.457962 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 16:50:59.458047 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.458011 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 16:50:59.458047 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.458012 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 16:50:59.458241 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.458048 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 16:50:59.458241 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.458227 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-whml5\"" Jul 29 16:50:59.458802 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.458780 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 16:50:59.458881 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.458780 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 16:50:59.459236 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.459222 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qdzf5\"" Jul 29 16:50:59.459778 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.459761 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.462158 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.462136 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k6z4n\"" Jul 29 16:50:59.462255 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.462179 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:50:59.462255 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.462185 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:50:59.462371 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.462296 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 16:50:59.462423 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.462395 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 16:50:59.465086 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.465058 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 16:50:59.465205 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.465089 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 16:50:59.465205 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.465174 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qw97l\"" Jul 29 16:50:59.480353 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.480336 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kg9wg" Jul 29 16:50:59.489215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.489196 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kg9wg" Jul 29 16:50:59.497225 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.497208 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:59.532258 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.532207 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" event={"ID":"51238a16678a7e2ea17ddbdcf5c3bea4","Type":"ContainerStarted","Data":"60b03196ee92c63945df95bfda1dd9aa7be6e675e7b74d0855169e352ce22ba2"} Jul 29 16:50:59.533346 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.533326 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" event={"ID":"682d0f3c94b790b049ee686bf8f84b61","Type":"ContainerStarted","Data":"ce8c7e39a6b014ff869f23004883f0e872fff3a7e5f5f0a145bb2318c1ad8627"} Jul 29 16:50:59.540886 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.540870 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 16:50:59.557689 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdde636e-430e-4801-aa33-53cb1f9d8834-iptables-alerter-script\") pod \"iptables-alerter-xlsrv\" (UID: \"cdde636e-430e-4801-aa33-53cb1f9d8834\") " pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.557786 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557700 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-systemd-units\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.557786 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-run-netns\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.557786 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557737 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5617951d-8f28-45a2-a22b-fcd4e7477040-tmp-dir\") pod \"node-resolver-ld22h\" (UID: \"5617951d-8f28-45a2-a22b-fcd4e7477040\") " pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.557786 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557758 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74dc9130-9427-43e2-a44a-ce0c2fd928e6-host\") pod \"node-ca-8n58r\" (UID: \"74dc9130-9427-43e2-a44a-ce0c2fd928e6\") " pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.557786 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557782 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/287647ea-606f-452e-9f4b-3533dcbdfef3-agent-certs\") pod \"konnectivity-agent-kdkxp\" (UID: \"287647ea-606f-452e-9f4b-3533dcbdfef3\") " pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:50:59.557949 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557795 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-systemd-units\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.557949 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-sysctl-d\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.557949 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557817 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-run-netns\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.557949 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557836 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-sysctl-conf\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.557949 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79474e7f-abba-4a5d-bdcb-8e1da121782e-tmp\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.557949 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557880 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-os-release\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.557949 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557902 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg47x\" (UniqueName: \"kubernetes.io/projected/51575911-62f1-48d9-a23e-35ca1fb96855-kube-api-access-dg47x\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.557949 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-kubernetes\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557949 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-sysctl-d\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557966 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-sysctl-conf\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557977 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-kubernetes\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.557990 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/287647ea-606f-452e-9f4b-3533dcbdfef3-konnectivity-ca\") pod \"konnectivity-agent-kdkxp\" (UID: \"287647ea-606f-452e-9f4b-3533dcbdfef3\") " pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-daemon-config\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558046 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-var-lib-openvswitch\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-cni-bin\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558130 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-cni-bin\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558138 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-host\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558155 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-var-lib-openvswitch\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558182 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5617951d-8f28-45a2-a22b-fcd4e7477040-hosts-file\") pod \"node-resolver-ld22h\" (UID: \"5617951d-8f28-45a2-a22b-fcd4e7477040\") " pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558214 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74dc9130-9427-43e2-a44a-ce0c2fd928e6-serviceca\") pod \"node-ca-8n58r\" (UID: \"74dc9130-9427-43e2-a44a-ce0c2fd928e6\") " pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558217 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-host\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-socket-dir-parent\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558247 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558295 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkrm5\" (UniqueName: \"kubernetes.io/projected/cdde636e-430e-4801-aa33-53cb1f9d8834-kube-api-access-kkrm5\") pod \"iptables-alerter-xlsrv\" (UID: \"cdde636e-430e-4801-aa33-53cb1f9d8834\") " pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-tuned\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.558338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558348 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-run-netns\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-system-cni-dir\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558418 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-os-release\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558464 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3374b880-ecef-4909-b431-070b77a83283-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558491 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdde636e-430e-4801-aa33-53cb1f9d8834-host-slash\") pod \"iptables-alerter-xlsrv\" (UID: \"cdde636e-430e-4801-aa33-53cb1f9d8834\") " pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-log-socket\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-registration-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-sysconfig\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558615 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-log-socket\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558598 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-cnibin\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558645 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-registration-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558653 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9997fefa-ee6f-4d92-8702-539daa3b846d-cni-binary-copy\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-slash\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558700 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-sysconfig\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558723 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-run-systemd\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558790 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-slash\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558839 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-run-systemd\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558869 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-node-log\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51575911-62f1-48d9-a23e-35ca1fb96855-ovnkube-config\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558933 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-node-log\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558954 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51575911-62f1-48d9-a23e-35ca1fb96855-ovn-node-metrics-cert\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.558982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-device-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-run-ovn\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-lib-modules\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559245 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-device-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559291 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-lib-modules\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-cni-dir\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559343 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-run-ovn-kubernetes\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559347 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-run-ovn\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559353 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-run-k8s-cni-cncf-io\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559422 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-conf-dir\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-etc-kubernetes\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559486 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/589260e8-5438-419f-b665-7e36b674bb99-kubelet-config\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:50:59.559827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559512 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51575911-62f1-48d9-a23e-35ca1fb96855-env-overrides\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-socket-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559687 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/51575911-62f1-48d9-a23e-35ca1fb96855-ovnkube-config\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsnvn\" (UniqueName: \"kubernetes.io/projected/ad2a8adc-3589-44a3-881b-155ea51373e9-kube-api-access-jsnvn\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8tdx\" (UniqueName: \"kubernetes.io/projected/1da775fc-ac1d-4a60-89cc-c18daa86454c-kube-api-access-s8tdx\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.559946 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-socket-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560018 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6z6q\" (UniqueName: \"kubernetes.io/projected/74dc9130-9427-43e2-a44a-ce0c2fd928e6-kube-api-access-x6z6q\") pod \"node-ca-8n58r\" (UID: \"74dc9130-9427-43e2-a44a-ce0c2fd928e6\") " pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-hostroot\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560139 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/51575911-62f1-48d9-a23e-35ca1fb96855-env-overrides\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560164 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3374b880-ecef-4909-b431-070b77a83283-cni-binary-copy\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560208 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs28f\" (UniqueName: \"kubernetes.io/projected/3374b880-ecef-4909-b431-070b77a83283-kube-api-access-bs28f\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560259 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-etc-openvswitch\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560293 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/589260e8-5438-419f-b665-7e36b674bb99-dbus\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560337 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-etc-openvswitch\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560366 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:50:59.560632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560448 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-sys-fs\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560521 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560607 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-var-lib-kubelet\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560634 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-system-cni-dir\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-var-lib-cni-multus\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-cnibin\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560698 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-var-lib-kubelet\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51575911-62f1-48d9-a23e-35ca1fb96855-ovnkube-script-lib\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560863 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-run\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560891 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8qnh\" (UniqueName: \"kubernetes.io/projected/79474e7f-abba-4a5d-bdcb-8e1da121782e-kube-api-access-r8qnh\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3374b880-ecef-4909-b431-070b77a83283-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-kubelet\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-run-openvswitch\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.561412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561044 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-run\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561070 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-systemd\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561138 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-sys\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561149 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-systemd\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561169 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddvvc\" (UniqueName: \"kubernetes.io/projected/5617951d-8f28-45a2-a22b-fcd4e7477040-kube-api-access-ddvvc\") pod \"node-resolver-ld22h\" (UID: \"5617951d-8f28-45a2-a22b-fcd4e7477040\") " pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561220 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-var-lib-cni-bin\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-run-multus-certs\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-cni-netd\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-modprobe-d\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561378 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561403 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-var-lib-kubelet\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561408 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/51575911-62f1-48d9-a23e-35ca1fb96855-ovnkube-script-lib\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561466 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-kubelet\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4chm\" (UniqueName: \"kubernetes.io/projected/9997fefa-ee6f-4d92-8702-539daa3b846d-kube-api-access-t4chm\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561511 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-run-openvswitch\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561528 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.562282 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/51575911-62f1-48d9-a23e-35ca1fb96855-host-cni-netd\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.563162 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561627 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-sys\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.563162 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.560665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad2a8adc-3589-44a3-881b-155ea51373e9-sys-fs\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.563162 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.561654 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-modprobe-d\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.563162 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.561741 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:59.563162 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.561815 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs podName:1da775fc-ac1d-4a60-89cc-c18daa86454c nodeName:}" failed. No retries permitted until 2026-07-29 16:51:00.06179247 +0000 UTC m=+3.024865351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs") pod "network-metrics-daemon-s29ts" (UID: "1da775fc-ac1d-4a60-89cc-c18daa86454c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:59.563162 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.562330 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79474e7f-abba-4a5d-bdcb-8e1da121782e-tmp\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.563162 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.562426 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/79474e7f-abba-4a5d-bdcb-8e1da121782e-etc-tuned\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.563162 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.562588 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/51575911-62f1-48d9-a23e-35ca1fb96855-ovn-node-metrics-cert\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.567655 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.567597 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg47x\" (UniqueName: \"kubernetes.io/projected/51575911-62f1-48d9-a23e-35ca1fb96855-kube-api-access-dg47x\") pod \"ovnkube-node-v9xpq\" (UID: \"51575911-62f1-48d9-a23e-35ca1fb96855\") " pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.568312 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.568289 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsnvn\" (UniqueName: \"kubernetes.io/projected/ad2a8adc-3589-44a3-881b-155ea51373e9-kube-api-access-jsnvn\") pod \"aws-ebs-csi-driver-node-956j9\" (UID: \"ad2a8adc-3589-44a3-881b-155ea51373e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.569208 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.569183 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8tdx\" (UniqueName: \"kubernetes.io/projected/1da775fc-ac1d-4a60-89cc-c18daa86454c-kube-api-access-s8tdx\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:50:59.569430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.569412 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8qnh\" (UniqueName: \"kubernetes.io/projected/79474e7f-abba-4a5d-bdcb-8e1da121782e-kube-api-access-r8qnh\") pod \"tuned-4vlzj\" (UID: \"79474e7f-abba-4a5d-bdcb-8e1da121782e\") " pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.661843 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.661807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-cni-dir\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662019 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.661848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-run-k8s-cni-cncf-io\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662019 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.661899 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-conf-dir\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662019 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.661915 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-etc-kubernetes\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662019 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.661938 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/589260e8-5438-419f-b665-7e36b674bb99-kubelet-config\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:50:59.662019 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.661960 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6z6q\" (UniqueName: \"kubernetes.io/projected/74dc9130-9427-43e2-a44a-ce0c2fd928e6-kube-api-access-x6z6q\") pod \"node-ca-8n58r\" (UID: \"74dc9130-9427-43e2-a44a-ce0c2fd928e6\") " pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.662019 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.661976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-hostroot\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662019 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.661994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3374b880-ecef-4909-b431-070b77a83283-cni-binary-copy\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.662019 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662000 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-conf-dir\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662019 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-cni-dir\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662013 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-etc-kubernetes\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs28f\" (UniqueName: \"kubernetes.io/projected/3374b880-ecef-4909-b431-070b77a83283-kube-api-access-bs28f\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/589260e8-5438-419f-b665-7e36b674bb99-dbus\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662099 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/589260e8-5438-419f-b665-7e36b674bb99-kubelet-config\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-hostroot\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662135 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662192 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/589260e8-5438-419f-b665-7e36b674bb99-dbus\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662193 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-run-k8s-cni-cncf-io\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-system-cni-dir\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.662225 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662240 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-var-lib-cni-multus\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662260 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-system-cni-dir\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662263 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-cnibin\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.662296 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret podName:589260e8-5438-419f-b665-7e36b674bb99 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:00.162275889 +0000 UTC m=+3.125348790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret") pod "global-pull-secret-syncer-77lxz" (UID: "589260e8-5438-419f-b665-7e36b674bb99") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662297 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-cnibin\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.662501 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662304 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-var-lib-cni-multus\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662345 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3374b880-ecef-4909-b431-070b77a83283-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662381 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddvvc\" (UniqueName: \"kubernetes.io/projected/5617951d-8f28-45a2-a22b-fcd4e7477040-kube-api-access-ddvvc\") pod \"node-resolver-ld22h\" (UID: \"5617951d-8f28-45a2-a22b-fcd4e7477040\") " pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662410 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-var-lib-cni-bin\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662436 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-run-multus-certs\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-var-lib-kubelet\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662484 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-var-lib-cni-bin\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662502 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4chm\" (UniqueName: \"kubernetes.io/projected/9997fefa-ee6f-4d92-8702-539daa3b846d-kube-api-access-t4chm\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662526 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662535 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-run-multus-certs\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662553 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdde636e-430e-4801-aa33-53cb1f9d8834-iptables-alerter-script\") pod \"iptables-alerter-xlsrv\" (UID: \"cdde636e-430e-4801-aa33-53cb1f9d8834\") " pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662562 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-var-lib-kubelet\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662581 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5617951d-8f28-45a2-a22b-fcd4e7477040-tmp-dir\") pod \"node-resolver-ld22h\" (UID: \"5617951d-8f28-45a2-a22b-fcd4e7477040\") " pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662604 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74dc9130-9427-43e2-a44a-ce0c2fd928e6-host\") pod \"node-ca-8n58r\" (UID: \"74dc9130-9427-43e2-a44a-ce0c2fd928e6\") " pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/287647ea-606f-452e-9f4b-3533dcbdfef3-agent-certs\") pod \"konnectivity-agent-kdkxp\" (UID: \"287647ea-606f-452e-9f4b-3533dcbdfef3\") " pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-os-release\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662701 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662712 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74dc9130-9427-43e2-a44a-ce0c2fd928e6-host\") pod \"node-ca-8n58r\" (UID: \"74dc9130-9427-43e2-a44a-ce0c2fd928e6\") " pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.663447 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662726 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/287647ea-606f-452e-9f4b-3533dcbdfef3-konnectivity-ca\") pod \"konnectivity-agent-kdkxp\" (UID: \"287647ea-606f-452e-9f4b-3533dcbdfef3\") " pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662741 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3374b880-ecef-4909-b431-070b77a83283-cni-binary-copy\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662864 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-daemon-config\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662886 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3374b880-ecef-4909-b431-070b77a83283-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662890 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-os-release\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662916 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5617951d-8f28-45a2-a22b-fcd4e7477040-hosts-file\") pod \"node-resolver-ld22h\" (UID: \"5617951d-8f28-45a2-a22b-fcd4e7477040\") " pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662922 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5617951d-8f28-45a2-a22b-fcd4e7477040-tmp-dir\") pod \"node-resolver-ld22h\" (UID: \"5617951d-8f28-45a2-a22b-fcd4e7477040\") " pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74dc9130-9427-43e2-a44a-ce0c2fd928e6-serviceca\") pod \"node-ca-8n58r\" (UID: \"74dc9130-9427-43e2-a44a-ce0c2fd928e6\") " pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-socket-dir-parent\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.662986 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5617951d-8f28-45a2-a22b-fcd4e7477040-hosts-file\") pod \"node-resolver-ld22h\" (UID: \"5617951d-8f28-45a2-a22b-fcd4e7477040\") " pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkrm5\" (UniqueName: \"kubernetes.io/projected/cdde636e-430e-4801-aa33-53cb1f9d8834-kube-api-access-kkrm5\") pod \"iptables-alerter-xlsrv\" (UID: \"cdde636e-430e-4801-aa33-53cb1f9d8834\") " pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-run-netns\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663035 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-socket-dir-parent\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663049 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-system-cni-dir\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-os-release\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663099 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3374b880-ecef-4909-b431-070b77a83283-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdde636e-430e-4801-aa33-53cb1f9d8834-host-slash\") pod \"iptables-alerter-xlsrv\" (UID: \"cdde636e-430e-4801-aa33-53cb1f9d8834\") " pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.664065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-cnibin\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9997fefa-ee6f-4d92-8702-539daa3b846d-cni-binary-copy\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663311 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-os-release\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663325 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-host-run-netns\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663358 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3374b880-ecef-4909-b431-070b77a83283-system-cni-dir\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663377 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdde636e-430e-4801-aa33-53cb1f9d8834-iptables-alerter-script\") pod \"iptables-alerter-xlsrv\" (UID: \"cdde636e-430e-4801-aa33-53cb1f9d8834\") " pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663377 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdde636e-430e-4801-aa33-53cb1f9d8834-host-slash\") pod \"iptables-alerter-xlsrv\" (UID: \"cdde636e-430e-4801-aa33-53cb1f9d8834\") " pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663418 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9997fefa-ee6f-4d92-8702-539daa3b846d-cnibin\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663453 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74dc9130-9427-43e2-a44a-ce0c2fd928e6-serviceca\") pod \"node-ca-8n58r\" (UID: \"74dc9130-9427-43e2-a44a-ce0c2fd928e6\") " pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663504 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9997fefa-ee6f-4d92-8702-539daa3b846d-multus-daemon-config\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/287647ea-606f-452e-9f4b-3533dcbdfef3-konnectivity-ca\") pod \"konnectivity-agent-kdkxp\" (UID: \"287647ea-606f-452e-9f4b-3533dcbdfef3\") " pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663699 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9997fefa-ee6f-4d92-8702-539daa3b846d-cni-binary-copy\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.664620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.663786 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3374b880-ecef-4909-b431-070b77a83283-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.665452 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.665434 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/287647ea-606f-452e-9f4b-3533dcbdfef3-agent-certs\") pod \"konnectivity-agent-kdkxp\" (UID: \"287647ea-606f-452e-9f4b-3533dcbdfef3\") " pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:50:59.673896 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.673841 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:50:59.673896 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.673865 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:50:59.673896 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.673880 2556 projected.go:196] Error preparing data for projected volume kube-api-access-x9mt9 for pod openshift-network-diagnostics/network-check-target-dng5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:59.674083 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:50:59.673990 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9 podName:2df87625-a6b8-4739-876f-a39cc90be9af nodeName:}" failed. No retries permitted until 2026-07-29 16:51:00.173968201 +0000 UTC m=+3.137041079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mt9" (UniqueName: "kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9") pod "network-check-target-dng5h" (UID: "2df87625-a6b8-4739-876f-a39cc90be9af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:59.674470 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.674444 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs28f\" (UniqueName: \"kubernetes.io/projected/3374b880-ecef-4909-b431-070b77a83283-kube-api-access-bs28f\") pod \"multus-additional-cni-plugins-w22hn\" (UID: \"3374b880-ecef-4909-b431-070b77a83283\") " pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.676148 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.676111 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddvvc\" (UniqueName: \"kubernetes.io/projected/5617951d-8f28-45a2-a22b-fcd4e7477040-kube-api-access-ddvvc\") pod \"node-resolver-ld22h\" (UID: \"5617951d-8f28-45a2-a22b-fcd4e7477040\") " pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.676384 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.676366 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4chm\" (UniqueName: \"kubernetes.io/projected/9997fefa-ee6f-4d92-8702-539daa3b846d-kube-api-access-t4chm\") pod \"multus-7wmfd\" (UID: \"9997fefa-ee6f-4d92-8702-539daa3b846d\") " pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.676849 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.676833 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkrm5\" (UniqueName: \"kubernetes.io/projected/cdde636e-430e-4801-aa33-53cb1f9d8834-kube-api-access-kkrm5\") pod \"iptables-alerter-xlsrv\" (UID: \"cdde636e-430e-4801-aa33-53cb1f9d8834\") " pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.676994 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.676979 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6z6q\" (UniqueName: \"kubernetes.io/projected/74dc9130-9427-43e2-a44a-ce0c2fd928e6-kube-api-access-x6z6q\") pod \"node-ca-8n58r\" (UID: \"74dc9130-9427-43e2-a44a-ce0c2fd928e6\") " pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.744717 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.744678 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" Jul 29 16:50:59.750607 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.750589 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" Jul 29 16:50:59.755803 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:59.755778 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2a8adc_3589_44a3_881b_155ea51373e9.slice/crio-12f097482d17ae9f8003570b8bae538429fe5852849d1b1d5da5d3f02376a1e7 WatchSource:0}: Error finding container 12f097482d17ae9f8003570b8bae538429fe5852849d1b1d5da5d3f02376a1e7: Status 404 returned error can't find the container with id 12f097482d17ae9f8003570b8bae538429fe5852849d1b1d5da5d3f02376a1e7 Jul 29 16:50:59.759823 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.759802 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:50:59.760028 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:59.760009 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79474e7f_abba_4a5d_bdcb_8e1da121782e.slice/crio-940443160c2b297576cc732d17dc6d193ad696049cdd885895d3b898d4963443 WatchSource:0}: Error finding container 940443160c2b297576cc732d17dc6d193ad696049cdd885895d3b898d4963443: Status 404 returned error can't find the container with id 940443160c2b297576cc732d17dc6d193ad696049cdd885895d3b898d4963443 Jul 29 16:50:59.765196 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.765176 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ld22h" Jul 29 16:50:59.769435 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:59.769412 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51575911_62f1_48d9_a23e_35ca1fb96855.slice/crio-be9172fd14731d970255a5880f6a93ac454385da16e6928b9cb9106118494739 WatchSource:0}: Error finding container be9172fd14731d970255a5880f6a93ac454385da16e6928b9cb9106118494739: Status 404 returned error can't find the container with id be9172fd14731d970255a5880f6a93ac454385da16e6928b9cb9106118494739 Jul 29 16:50:59.771202 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.771070 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8n58r" Jul 29 16:50:59.776558 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:59.776526 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5617951d_8f28_45a2_a22b_fcd4e7477040.slice/crio-7be14e138c153998647611320043de37f3e5aa2debc5af114c560dc2fb02bf8b WatchSource:0}: Error finding container 7be14e138c153998647611320043de37f3e5aa2debc5af114c560dc2fb02bf8b: Status 404 returned error can't find the container with id 7be14e138c153998647611320043de37f3e5aa2debc5af114c560dc2fb02bf8b Jul 29 16:50:59.777214 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.777199 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7wmfd" Jul 29 16:50:59.781377 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:59.781359 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74dc9130_9427_43e2_a44a_ce0c2fd928e6.slice/crio-e524f2fb731faecc60cc80d02377ccee5d83d7a3e1c0a1abaf92fda7d18fa7e6 WatchSource:0}: Error finding container e524f2fb731faecc60cc80d02377ccee5d83d7a3e1c0a1abaf92fda7d18fa7e6: Status 404 returned error can't find the container with id e524f2fb731faecc60cc80d02377ccee5d83d7a3e1c0a1abaf92fda7d18fa7e6 Jul 29 16:50:59.782899 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.782876 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w22hn" Jul 29 16:50:59.785511 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:59.785490 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9997fefa_ee6f_4d92_8702_539daa3b846d.slice/crio-384d0f481492228bb2784b1fb28b7b8369df4b3d4e5b77c13f7b980d445e993f WatchSource:0}: Error finding container 384d0f481492228bb2784b1fb28b7b8369df4b3d4e5b77c13f7b980d445e993f: Status 404 returned error can't find the container with id 384d0f481492228bb2784b1fb28b7b8369df4b3d4e5b77c13f7b980d445e993f Jul 29 16:50:59.789522 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.789505 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xlsrv" Jul 29 16:50:59.790956 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:59.790937 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3374b880_ecef_4909_b431_070b77a83283.slice/crio-824012795b6c8e283e552c3c17d521ebc41daef5ac88be3b4386dc42d8209438 WatchSource:0}: Error finding container 824012795b6c8e283e552c3c17d521ebc41daef5ac88be3b4386dc42d8209438: Status 404 returned error can't find the container with id 824012795b6c8e283e552c3c17d521ebc41daef5ac88be3b4386dc42d8209438 Jul 29 16:50:59.794397 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:50:59.794380 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:50:59.798912 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:59.798888 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdde636e_430e_4801_aa33_53cb1f9d8834.slice/crio-9504cbae8a0cd812b2905c937434346e143ebbd154723e601aa82a5e7ef000dd WatchSource:0}: Error finding container 9504cbae8a0cd812b2905c937434346e143ebbd154723e601aa82a5e7ef000dd: Status 404 returned error can't find the container with id 9504cbae8a0cd812b2905c937434346e143ebbd154723e601aa82a5e7ef000dd Jul 29 16:50:59.802934 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:50:59.802915 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287647ea_606f_452e_9f4b_3533dcbdfef3.slice/crio-f6e5b0132db2b68a0aa198ef6e627e76a6816c82828416fd003b392d9d72183a WatchSource:0}: Error finding container f6e5b0132db2b68a0aa198ef6e627e76a6816c82828416fd003b392d9d72183a: Status 404 returned error can't find the container with id f6e5b0132db2b68a0aa198ef6e627e76a6816c82828416fd003b392d9d72183a Jul 29 16:51:00.066384 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.066285 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:00.066531 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.066449 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:00.066531 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.066515 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs podName:1da775fc-ac1d-4a60-89cc-c18daa86454c nodeName:}" failed. No retries permitted until 2026-07-29 16:51:01.066500095 +0000 UTC m=+4.029572979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs") pod "network-metrics-daemon-s29ts" (UID: "1da775fc-ac1d-4a60-89cc-c18daa86454c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:00.167431 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.167393 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:00.167632 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.167586 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:00.167703 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.167666 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret podName:589260e8-5438-419f-b665-7e36b674bb99 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:01.167644632 +0000 UTC m=+4.130717532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret") pod "global-pull-secret-syncer-77lxz" (UID: "589260e8-5438-419f-b665-7e36b674bb99") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:00.268434 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.268393 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:00.268657 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.268634 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:51:00.268745 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.268664 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:51:00.268745 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.268678 2556 projected.go:196] Error preparing data for projected volume kube-api-access-x9mt9 for pod openshift-network-diagnostics/network-check-target-dng5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:00.269196 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.268879 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9 podName:2df87625-a6b8-4739-876f-a39cc90be9af nodeName:}" failed. No retries permitted until 2026-07-29 16:51:01.268857289 +0000 UTC m=+4.231930172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mt9" (UniqueName: "kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9") pod "network-check-target-dng5h" (UID: "2df87625-a6b8-4739-876f-a39cc90be9af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:00.492772 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.492684 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 16:45:59 +0000 UTC" deadline="2028-02-19 04:53:44.83221309 +0000 UTC" Jul 29 16:51:00.492772 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.492735 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13668h2m44.339495481s" Jul 29 16:51:00.528459 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.528430 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:00.528611 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.528569 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:00.535776 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.535280 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:00.535776 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:00.535509 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:00.543137 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.543089 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdkxp" event={"ID":"287647ea-606f-452e-9f4b-3533dcbdfef3","Type":"ContainerStarted","Data":"f6e5b0132db2b68a0aa198ef6e627e76a6816c82828416fd003b392d9d72183a"} Jul 29 16:51:00.545992 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.545962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w22hn" event={"ID":"3374b880-ecef-4909-b431-070b77a83283","Type":"ContainerStarted","Data":"824012795b6c8e283e552c3c17d521ebc41daef5ac88be3b4386dc42d8209438"} Jul 29 16:51:00.557754 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.557691 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ld22h" event={"ID":"5617951d-8f28-45a2-a22b-fcd4e7477040","Type":"ContainerStarted","Data":"7be14e138c153998647611320043de37f3e5aa2debc5af114c560dc2fb02bf8b"} Jul 29 16:51:00.562117 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.562053 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" event={"ID":"79474e7f-abba-4a5d-bdcb-8e1da121782e","Type":"ContainerStarted","Data":"940443160c2b297576cc732d17dc6d193ad696049cdd885895d3b898d4963443"} Jul 29 16:51:00.563700 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.563660 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xlsrv" event={"ID":"cdde636e-430e-4801-aa33-53cb1f9d8834","Type":"ContainerStarted","Data":"9504cbae8a0cd812b2905c937434346e143ebbd154723e601aa82a5e7ef000dd"} Jul 29 16:51:00.565715 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.565690 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7wmfd" event={"ID":"9997fefa-ee6f-4d92-8702-539daa3b846d","Type":"ContainerStarted","Data":"384d0f481492228bb2784b1fb28b7b8369df4b3d4e5b77c13f7b980d445e993f"} Jul 29 16:51:00.567290 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.567266 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8n58r" event={"ID":"74dc9130-9427-43e2-a44a-ce0c2fd928e6","Type":"ContainerStarted","Data":"e524f2fb731faecc60cc80d02377ccee5d83d7a3e1c0a1abaf92fda7d18fa7e6"} Jul 29 16:51:00.574379 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.574351 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" event={"ID":"51575911-62f1-48d9-a23e-35ca1fb96855","Type":"ContainerStarted","Data":"be9172fd14731d970255a5880f6a93ac454385da16e6928b9cb9106118494739"} Jul 29 16:51:00.576978 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:00.576951 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" event={"ID":"ad2a8adc-3589-44a3-881b-155ea51373e9","Type":"ContainerStarted","Data":"12f097482d17ae9f8003570b8bae538429fe5852849d1b1d5da5d3f02376a1e7"} Jul 29 16:51:01.076426 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:01.075685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:01.076426 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:01.075923 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:01.076426 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:01.075995 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs podName:1da775fc-ac1d-4a60-89cc-c18daa86454c nodeName:}" failed. No retries permitted until 2026-07-29 16:51:03.075973803 +0000 UTC m=+6.039046706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs") pod "network-metrics-daemon-s29ts" (UID: "1da775fc-ac1d-4a60-89cc-c18daa86454c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:01.177509 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:01.176859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:01.177509 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:01.177050 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:01.177509 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:01.177161 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret podName:589260e8-5438-419f-b665-7e36b674bb99 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:03.177113685 +0000 UTC m=+6.140186578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret") pod "global-pull-secret-syncer-77lxz" (UID: "589260e8-5438-419f-b665-7e36b674bb99") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:01.278373 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:01.277698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:01.278373 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:01.277894 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:51:01.278373 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:01.277914 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:51:01.278373 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:01.277926 2556 projected.go:196] Error preparing data for projected volume kube-api-access-x9mt9 for pod openshift-network-diagnostics/network-check-target-dng5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:01.278373 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:01.277986 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9 podName:2df87625-a6b8-4739-876f-a39cc90be9af nodeName:}" failed. No retries permitted until 2026-07-29 16:51:03.277968224 +0000 UTC m=+6.241041138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mt9" (UniqueName: "kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9") pod "network-check-target-dng5h" (UID: "2df87625-a6b8-4739-876f-a39cc90be9af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:01.493656 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:01.493524 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 16:45:59 +0000 UTC" deadline="2028-04-02 00:13:00.103259999 +0000 UTC" Jul 29 16:51:01.493656 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:01.493601 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14695h21m58.609663391s" Jul 29 16:51:01.530590 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:01.530560 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:01.530772 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:01.530703 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:02.528413 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:02.528379 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:02.528897 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:02.528512 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:02.528980 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:02.528898 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:02.529038 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:02.528993 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:03.093998 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:03.093339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:03.093998 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:03.093483 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:03.093998 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:03.093541 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs podName:1da775fc-ac1d-4a60-89cc-c18daa86454c nodeName:}" failed. No retries permitted until 2026-07-29 16:51:07.09352309 +0000 UTC m=+10.056595970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs") pod "network-metrics-daemon-s29ts" (UID: "1da775fc-ac1d-4a60-89cc-c18daa86454c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:03.194654 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:03.194015 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:03.194654 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:03.194191 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:03.194654 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:03.194247 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret podName:589260e8-5438-419f-b665-7e36b674bb99 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:07.194230945 +0000 UTC m=+10.157303834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret") pod "global-pull-secret-syncer-77lxz" (UID: "589260e8-5438-419f-b665-7e36b674bb99") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:03.295307 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:03.294596 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:03.295307 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:03.294875 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:51:03.295307 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:03.294894 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:51:03.295307 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:03.294908 2556 projected.go:196] Error preparing data for projected volume kube-api-access-x9mt9 for pod openshift-network-diagnostics/network-check-target-dng5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:03.295307 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:03.294962 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9 podName:2df87625-a6b8-4739-876f-a39cc90be9af nodeName:}" failed. No retries permitted until 2026-07-29 16:51:07.294944282 +0000 UTC m=+10.258017164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mt9" (UniqueName: "kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9") pod "network-check-target-dng5h" (UID: "2df87625-a6b8-4739-876f-a39cc90be9af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:03.528362 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:03.528286 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:03.528526 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:03.528434 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:04.527955 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:04.527918 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:04.528155 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:04.527979 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:04.528235 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:04.528173 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:04.528553 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:04.528526 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:05.528362 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:05.528327 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:05.528529 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:05.528502 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:06.527919 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:06.527848 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:06.528406 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:06.527980 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:06.528406 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:06.528087 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:06.528406 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:06.528174 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:07.127709 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:07.127646 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:07.127885 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:07.127804 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:07.127885 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:07.127865 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs podName:1da775fc-ac1d-4a60-89cc-c18daa86454c nodeName:}" failed. No retries permitted until 2026-07-29 16:51:15.127847761 +0000 UTC m=+18.090920652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs") pod "network-metrics-daemon-s29ts" (UID: "1da775fc-ac1d-4a60-89cc-c18daa86454c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:07.228366 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:07.228318 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:07.228546 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:07.228466 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:07.228546 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:07.228542 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret podName:589260e8-5438-419f-b665-7e36b674bb99 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:15.228521997 +0000 UTC m=+18.191594897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret") pod "global-pull-secret-syncer-77lxz" (UID: "589260e8-5438-419f-b665-7e36b674bb99") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:07.329759 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:07.329721 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:07.329940 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:07.329909 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:51:07.329940 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:07.329928 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:51:07.329940 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:07.329939 2556 projected.go:196] Error preparing data for projected volume kube-api-access-x9mt9 for pod openshift-network-diagnostics/network-check-target-dng5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:07.330205 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:07.330000 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9 podName:2df87625-a6b8-4739-876f-a39cc90be9af nodeName:}" failed. No retries permitted until 2026-07-29 16:51:15.329979681 +0000 UTC m=+18.293052581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mt9" (UniqueName: "kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9") pod "network-check-target-dng5h" (UID: "2df87625-a6b8-4739-876f-a39cc90be9af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:07.531627 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:07.531545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:07.532093 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:07.531670 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:08.529160 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:08.528573 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:08.529160 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:08.528691 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:08.529160 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:08.528749 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:08.529160 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:08.528824 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:09.530921 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:09.530895 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:09.531428 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:09.531001 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:10.528090 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:10.528043 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:10.528090 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:10.528092 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:10.528294 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:10.528168 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:10.528354 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:10.528288 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:11.528748 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:11.528710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:11.529226 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:11.528857 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:12.528567 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:12.528482 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:12.528721 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:12.528598 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:12.528721 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:12.528652 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:12.529104 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:12.528767 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:13.528610 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:13.528576 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:13.528789 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:13.528714 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:14.528462 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:14.528433 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:14.528677 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:14.528554 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:14.528677 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:14.528608 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:14.528793 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:14.528711 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:15.185654 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:15.185615 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:15.185852 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:15.185738 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:15.185852 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:15.185796 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs podName:1da775fc-ac1d-4a60-89cc-c18daa86454c nodeName:}" failed. No retries permitted until 2026-07-29 16:51:31.185779421 +0000 UTC m=+34.148852301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs") pod "network-metrics-daemon-s29ts" (UID: "1da775fc-ac1d-4a60-89cc-c18daa86454c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:15.286663 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:15.286624 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:15.286819 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:15.286757 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:15.286866 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:15.286821 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret podName:589260e8-5438-419f-b665-7e36b674bb99 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:31.286806961 +0000 UTC m=+34.249879838 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret") pod "global-pull-secret-syncer-77lxz" (UID: "589260e8-5438-419f-b665-7e36b674bb99") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:15.387171 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:15.387129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:15.387551 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:15.387521 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:51:15.387699 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:15.387554 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:51:15.387699 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:15.387579 2556 projected.go:196] Error preparing data for projected volume kube-api-access-x9mt9 for pod openshift-network-diagnostics/network-check-target-dng5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:15.387805 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:15.387791 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9 podName:2df87625-a6b8-4739-876f-a39cc90be9af nodeName:}" failed. No retries permitted until 2026-07-29 16:51:31.387776068 +0000 UTC m=+34.350848944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mt9" (UniqueName: "kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9") pod "network-check-target-dng5h" (UID: "2df87625-a6b8-4739-876f-a39cc90be9af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:15.528455 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:15.528426 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:15.528614 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:15.528555 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:16.528883 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:16.528708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:16.529323 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:16.528709 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:16.529323 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:16.528964 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:16.529323 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:16.529069 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:17.528855 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:17.528827 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:17.529030 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:17.528928 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:18.527953 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:18.527917 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:18.528134 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:18.527929 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:18.528134 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:18.528034 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:18.528210 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:18.528175 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:19.528855 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:19.528817 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:19.529417 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:19.528966 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:20.528169 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.527991 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:20.528327 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.527991 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:20.528327 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:20.528266 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:20.528445 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:20.528317 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:20.615797 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.615726 2556 generic.go:356] "Generic (PLEG): container finished" podID="3374b880-ecef-4909-b431-070b77a83283" containerID="ab0243dc4f793c2c0867db0a1a551c125ecac2212db703788049ca3eb701c2c1" exitCode=0 Jul 29 16:51:20.616647 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.615800 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w22hn" event={"ID":"3374b880-ecef-4909-b431-070b77a83283","Type":"ContainerDied","Data":"ab0243dc4f793c2c0867db0a1a551c125ecac2212db703788049ca3eb701c2c1"} Jul 29 16:51:20.617305 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.617257 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ld22h" event={"ID":"5617951d-8f28-45a2-a22b-fcd4e7477040","Type":"ContainerStarted","Data":"6d5e85f1086ddc9f426a718182da7ffd3b1076e277a44f42521893cbd21585b7"} Jul 29 16:51:20.618775 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.618740 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" event={"ID":"79474e7f-abba-4a5d-bdcb-8e1da121782e","Type":"ContainerStarted","Data":"5e41df2c63ba139168d8ed470617400ea910d82112d58f62cd1b771bf607bfd3"} Jul 29 16:51:20.620091 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.620071 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7wmfd" event={"ID":"9997fefa-ee6f-4d92-8702-539daa3b846d","Type":"ContainerStarted","Data":"0830f5491a52281881f985a8b44edf588a78cce88eb9e075c086763a59da156d"} Jul 29 16:51:20.621520 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.621492 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8n58r" event={"ID":"74dc9130-9427-43e2-a44a-ce0c2fd928e6","Type":"ContainerStarted","Data":"17f7d234993fb8609c75b1ffde6787aebf17c8cfa8f94314ead5a0e473ff4202"} Jul 29 16:51:20.624431 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.624412 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" event={"ID":"51575911-62f1-48d9-a23e-35ca1fb96855","Type":"ContainerStarted","Data":"8a7036fa0155ead9656c6aa212544584b6790a4a5d408a4f5a8a9873fa2835c9"} Jul 29 16:51:20.624526 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.624483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" event={"ID":"51575911-62f1-48d9-a23e-35ca1fb96855","Type":"ContainerStarted","Data":"b843098cbff605bd7bada3108e2f1d871329539d429af98e52a1f5c14602b696"} Jul 29 16:51:20.624587 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.624534 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" event={"ID":"51575911-62f1-48d9-a23e-35ca1fb96855","Type":"ContainerStarted","Data":"b0344758bcf6dfd9e1799bcc7b57dc76b179e53be0705630fdd290ae00473317"} Jul 29 16:51:20.624641 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.624584 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" event={"ID":"51575911-62f1-48d9-a23e-35ca1fb96855","Type":"ContainerStarted","Data":"b986da13aa1e3f9e1c460105b5cc2ad5832ce7ead97ee0df80c0b2ac611b527d"} Jul 29 16:51:20.624641 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.624632 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" event={"ID":"51575911-62f1-48d9-a23e-35ca1fb96855","Type":"ContainerStarted","Data":"ea8ff4020c4ce74de4c94f970f37df7d7b12f45c599546fb012a2bff8c2f08cf"} Jul 29 16:51:20.624740 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.624682 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" event={"ID":"51575911-62f1-48d9-a23e-35ca1fb96855","Type":"ContainerStarted","Data":"aa3a213d25e8aee9f68a0695b4baa4ce3c4a01dcb69d740ce7eee704495f8b74"} Jul 29 16:51:20.625664 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.625645 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" event={"ID":"ad2a8adc-3589-44a3-881b-155ea51373e9","Type":"ContainerStarted","Data":"4ba83d5884c182748a7310318f72947d5f266b797ef205f7c8eb3e0634c348f2"} Jul 29 16:51:20.626814 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.626796 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" event={"ID":"51238a16678a7e2ea17ddbdcf5c3bea4","Type":"ContainerStarted","Data":"d5de9a991d751dba28b1c2c750bc593961cd4ec57c7244b15222f017761a1197"} Jul 29 16:51:20.628094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.628076 2556 generic.go:356] "Generic (PLEG): container finished" podID="682d0f3c94b790b049ee686bf8f84b61" containerID="db08ee043bf7dd20620888d0fb6a16c006d9f6d5b444531d84fa1d7bf82de06a" exitCode=0 Jul 29 16:51:20.628186 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.628139 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" event={"ID":"682d0f3c94b790b049ee686bf8f84b61","Type":"ContainerDied","Data":"db08ee043bf7dd20620888d0fb6a16c006d9f6d5b444531d84fa1d7bf82de06a"} Jul 29 16:51:20.629451 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.629433 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kdkxp" event={"ID":"287647ea-606f-452e-9f4b-3533dcbdfef3","Type":"ContainerStarted","Data":"c11e614f18ed3de355e958154d0971fc7ca46a001711c0376f6f21b94b0d89f8"} Jul 29 16:51:20.675812 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.675644 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7wmfd" podStartSLOduration=2.709104708 podStartE2EDuration="22.675630971s" totalImagesPullingTime="19.966526263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:20.675323317 +0000 UTC m=+23.638396215" watchObservedRunningTime="2026-07-29 16:51:20.675630971 +0000 UTC m=+23.638703871" Jul 29 16:51:20.715145 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.715107 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kdkxp" podStartSLOduration=2.8229148779999997 podStartE2EDuration="22.71509273s" totalImagesPullingTime="19.892177852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:20.693677529 +0000 UTC m=+23.656750428" watchObservedRunningTime="2026-07-29 16:51:20.71509273 +0000 UTC m=+23.678165629" Jul 29 16:51:20.735259 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.735218 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4vlzj" podStartSLOduration=2.782349092 podStartE2EDuration="22.735204037s" totalImagesPullingTime="19.952854945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:20.714753782 +0000 UTC m=+23.677826681" watchObservedRunningTime="2026-07-29 16:51:20.735204037 +0000 UTC m=+23.698276927" Jul 29 16:51:20.735685 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.735655 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8n58r" podStartSLOduration=2.826057519 podStartE2EDuration="22.735645842s" totalImagesPullingTime="19.909588323s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:20.735625479 +0000 UTC m=+23.698698378" watchObservedRunningTime="2026-07-29 16:51:20.735645842 +0000 UTC m=+23.698718765" Jul 29 16:51:20.757003 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:20.756963 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-134.ec2.internal" podStartSLOduration=22.756945508 podStartE2EDuration="22.756945508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:20.756681621 +0000 UTC m=+23.719754520" watchObservedRunningTime="2026-07-29 16:51:20.756945508 +0000 UTC m=+23.720018410" Jul 29 16:51:21.528029 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:21.528003 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:21.528184 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:21.528145 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:21.550674 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:21.550651 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 16:51:21.634437 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:21.634407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" event={"ID":"682d0f3c94b790b049ee686bf8f84b61","Type":"ContainerStarted","Data":"09abffd8ff9ef2f0497d06cc2a5843a7ed6293508719bf2a97275c438bb4670f"} Jul 29 16:51:21.636039 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:21.636010 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xlsrv" event={"ID":"cdde636e-430e-4801-aa33-53cb1f9d8834","Type":"ContainerStarted","Data":"f2e13bbd7ab8ed3ac4a5e2e6120a55713273e7d75a7085ecd2541a852090290f"} Jul 29 16:51:21.638075 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:21.637896 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" event={"ID":"ad2a8adc-3589-44a3-881b-155ea51373e9","Type":"ContainerStarted","Data":"a8aea22c9fe11b634a56dd4c96b3db5839b21ae2d8c5cf11188a89405a9ae114"} Jul 29 16:51:21.654622 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:21.654579 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ld22h" podStartSLOduration=3.740521616 podStartE2EDuration="23.65456571s" totalImagesPullingTime="19.914044094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:20.810676313 +0000 UTC m=+23.773749213" watchObservedRunningTime="2026-07-29 16:51:21.65456571 +0000 UTC m=+24.617638609" Jul 29 16:51:21.676205 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:21.676115 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-134.ec2.internal" podStartSLOduration=23.676103597 podStartE2EDuration="23.676103597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:21.65445635 +0000 UTC m=+24.617529250" watchObservedRunningTime="2026-07-29 16:51:21.676103597 +0000 UTC m=+24.639176495" Jul 29 16:51:21.676699 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:21.676659 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xlsrv" podStartSLOduration=3.7761880850000002 podStartE2EDuration="23.676646457s" totalImagesPullingTime="19.900458372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:21.676510153 +0000 UTC m=+24.639583051" watchObservedRunningTime="2026-07-29 16:51:21.676646457 +0000 UTC m=+24.639719358" Jul 29 16:51:22.513965 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:22.513855 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T16:51:21.550669224Z","UUID":"188785e2-672b-4289-b2d0-f14d543a7c31","Handler":null,"Name":"","Endpoint":""} Jul 29 16:51:22.515563 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:22.515541 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 16:51:22.515669 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:22.515584 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 16:51:22.528668 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:22.528646 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:22.528752 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:22.528666 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:22.528752 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:22.528740 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:22.528891 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:22.528869 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:22.644496 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:22.644094 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" event={"ID":"51575911-62f1-48d9-a23e-35ca1fb96855","Type":"ContainerStarted","Data":"df3be0abd7dc650ae5895c09d5deab0c64b7023aebcc329920858ac366ec624a"} Jul 29 16:51:23.531120 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:23.528435 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:23.531120 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:23.528636 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:23.652537 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:23.652506 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" event={"ID":"ad2a8adc-3589-44a3-881b-155ea51373e9","Type":"ContainerStarted","Data":"a04c31f15ef5fc7d7b45abc70da000468d4dbe09e87d871f883cf2d156c75887"} Jul 29 16:51:23.677350 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:23.677293 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-956j9" podStartSLOduration=7.210152353 podStartE2EDuration="25.677272099s" totalImagesPullingTime="18.467119746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:23.676737093 +0000 UTC m=+26.639809992" watchObservedRunningTime="2026-07-29 16:51:23.677272099 +0000 UTC m=+26.640344999" Jul 29 16:51:23.857313 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:23.857235 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:51:23.858025 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:23.858002 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:51:24.528687 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:24.528652 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:24.528863 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:24.528652 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:24.528863 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:24.528756 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:24.528863 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:24.528832 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:25.528392 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.528242 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:25.528938 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:25.528473 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:25.659084 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.659032 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" event={"ID":"51575911-62f1-48d9-a23e-35ca1fb96855","Type":"ContainerStarted","Data":"b291198958563f3028e424efb804272482c326c07a640e02cc71832b8ab459ac"} Jul 29 16:51:25.659312 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.659279 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:51:25.659579 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.659341 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:51:25.659579 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.659388 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:51:25.661083 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.661036 2556 generic.go:356] "Generic (PLEG): container finished" podID="3374b880-ecef-4909-b431-070b77a83283" containerID="156a7c3dd1d4efeba057359dfd0f2e50666b6e30a6f5c8cfb11be8787c81269e" exitCode=0 Jul 29 16:51:25.661083 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.661074 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w22hn" event={"ID":"3374b880-ecef-4909-b431-070b77a83283","Type":"ContainerDied","Data":"156a7c3dd1d4efeba057359dfd0f2e50666b6e30a6f5c8cfb11be8787c81269e"} Jul 29 16:51:25.674589 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.674566 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:51:25.674673 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.674652 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:51:25.695443 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:25.695407 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" podStartSLOduration=7.699720078 podStartE2EDuration="27.695393556s" totalImagesPullingTime="19.995673478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:25.694431686 +0000 UTC m=+28.657504584" watchObservedRunningTime="2026-07-29 16:51:25.695393556 +0000 UTC m=+28.658466456" Jul 29 16:51:26.528098 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:26.528061 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:26.528098 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:26.528089 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:26.528422 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:26.528197 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:26.528422 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:26.528318 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:26.967059 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:26.966863 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dng5h"] Jul 29 16:51:26.967284 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:26.967143 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:26.967284 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:26.967230 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:26.968806 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:26.968776 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-77lxz"] Jul 29 16:51:26.968925 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:26.968863 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:26.968963 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:26.968937 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:26.971696 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:26.971671 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s29ts"] Jul 29 16:51:26.971827 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:26.971778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:26.971891 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:26.971869 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:27.667694 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:27.667658 2556 generic.go:356] "Generic (PLEG): container finished" podID="3374b880-ecef-4909-b431-070b77a83283" containerID="7bd3182c6f1ae95d945e04ce3ae474239b83553ab046211ce5dae0f606e4d634" exitCode=0 Jul 29 16:51:27.668094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:27.667744 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w22hn" event={"ID":"3374b880-ecef-4909-b431-070b77a83283","Type":"ContainerDied","Data":"7bd3182c6f1ae95d945e04ce3ae474239b83553ab046211ce5dae0f606e4d634"} Jul 29 16:51:28.311845 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:28.311808 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:51:28.312009 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:28.311998 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 16:51:28.312376 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:28.312349 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kdkxp" Jul 29 16:51:28.528080 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:28.528036 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:28.528080 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:28.528062 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:28.528305 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:28.528138 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:28.528305 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:28.528250 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:28.528430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:28.528319 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:28.528430 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:28.528394 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:29.674112 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:29.674064 2556 generic.go:356] "Generic (PLEG): container finished" podID="3374b880-ecef-4909-b431-070b77a83283" containerID="ff5d2240336cec14e8bc6669ad41d463c0397ad08d8b896aac4466437b3067d5" exitCode=0 Jul 29 16:51:29.674112 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:29.674105 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w22hn" event={"ID":"3374b880-ecef-4909-b431-070b77a83283","Type":"ContainerDied","Data":"ff5d2240336cec14e8bc6669ad41d463c0397ad08d8b896aac4466437b3067d5"} Jul 29 16:51:30.528512 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:30.528474 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:30.528705 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:30.528587 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:30.528705 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:30.528594 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:30.528705 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:30.528622 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:30.528831 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:30.528706 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:30.528831 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:30.528784 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:31.205794 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:31.205752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:31.206189 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:31.205923 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:31.206189 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:31.205998 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs podName:1da775fc-ac1d-4a60-89cc-c18daa86454c nodeName:}" failed. No retries permitted until 2026-07-29 16:52:03.205975471 +0000 UTC m=+66.169048368 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs") pod "network-metrics-daemon-s29ts" (UID: "1da775fc-ac1d-4a60-89cc-c18daa86454c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:31.306621 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:31.306582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:31.306782 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:31.306745 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:31.306837 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:31.306814 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret podName:589260e8-5438-419f-b665-7e36b674bb99 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:03.30679509 +0000 UTC m=+66.269867988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret") pod "global-pull-secret-syncer-77lxz" (UID: "589260e8-5438-419f-b665-7e36b674bb99") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:31.407136 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:31.407101 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:31.407285 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:31.407266 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:51:31.407336 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:31.407291 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:51:31.407336 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:31.407300 2556 projected.go:196] Error preparing data for projected volume kube-api-access-x9mt9 for pod openshift-network-diagnostics/network-check-target-dng5h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:31.407409 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:31.407349 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9 podName:2df87625-a6b8-4739-876f-a39cc90be9af nodeName:}" failed. No retries permitted until 2026-07-29 16:52:03.407336025 +0000 UTC m=+66.370408906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x9mt9" (UniqueName: "kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9") pod "network-check-target-dng5h" (UID: "2df87625-a6b8-4739-876f-a39cc90be9af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:32.528003 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.527930 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:32.528003 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.527962 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:32.528003 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.527962 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:32.528513 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:32.528086 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s29ts" podUID="1da775fc-ac1d-4a60-89cc-c18daa86454c" Jul 29 16:51:32.528513 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:32.528186 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dng5h" podUID="2df87625-a6b8-4739-876f-a39cc90be9af" Jul 29 16:51:32.528513 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:32.528274 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-77lxz" podUID="589260e8-5438-419f-b665-7e36b674bb99" Jul 29 16:51:32.843503 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.843431 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-134.ec2.internal" event="NodeReady" Jul 29 16:51:32.843651 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.843605 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 16:51:32.880546 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.880445 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78f954dbcf-hc7tx"] Jul 29 16:51:32.911346 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.911321 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9w5dd"] Jul 29 16:51:32.911524 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.911457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:32.914181 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.914154 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 16:51:32.914356 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.914196 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 16:51:32.914356 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.914258 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2pg7b\"" Jul 29 16:51:32.914356 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.914333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 16:51:32.920189 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.920165 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 16:51:32.924619 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.924598 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f954dbcf-hc7tx"] Jul 29 16:51:32.924724 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.924632 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s9hcc"] Jul 29 16:51:32.924783 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.924730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:32.927322 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.927302 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 16:51:32.927423 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.927399 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p46rx\"" Jul 29 16:51:32.927518 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.927498 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 16:51:32.940339 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.940319 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9w5dd"] Jul 29 16:51:32.940435 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.940352 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9hcc"] Jul 29 16:51:32.940435 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.940419 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9hcc" Jul 29 16:51:32.942881 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.942849 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 16:51:32.942881 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.942859 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 16:51:32.942881 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.942879 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 16:51:32.943189 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:32.943174 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b5ksb\"" Jul 29 16:51:33.018494 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018461 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-bound-sa-token\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.018670 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018531 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7f3887b-6db3-4b15-9874-8403eed85250-config-volume\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.018670 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018557 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.018670 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nh98\" (UniqueName: \"kubernetes.io/projected/a7f3887b-6db3-4b15-9874-8403eed85250-kube-api-access-6nh98\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.018670 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7db8c4c-f98f-4446-be03-ccce318d5563-cert\") pod \"ingress-canary-s9hcc\" (UID: \"d7db8c4c-f98f-4446-be03-ccce318d5563\") " pod="openshift-ingress-canary/ingress-canary-s9hcc" Jul 29 16:51:33.018670 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018628 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f3887b-6db3-4b15-9874-8403eed85250-tmp-dir\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.018867 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018705 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-installation-pull-secrets\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.018867 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018757 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-certificates\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.018867 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018789 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhzjm\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-kube-api-access-jhzjm\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.018867 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cnl9\" (UniqueName: \"kubernetes.io/projected/d7db8c4c-f98f-4446-be03-ccce318d5563-kube-api-access-4cnl9\") pod \"ingress-canary-s9hcc\" (UID: \"d7db8c4c-f98f-4446-be03-ccce318d5563\") " pod="openshift-ingress-canary/ingress-canary-s9hcc" Jul 29 16:51:33.018867 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-image-registry-private-configuration\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.018867 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018865 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.019158 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018889 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-ca-trust-extracted\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.019158 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.018905 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-trusted-ca\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.119832 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.119753 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-bound-sa-token\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.119982 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.119834 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7f3887b-6db3-4b15-9874-8403eed85250-config-volume\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.119982 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.119864 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.119982 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.119886 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nh98\" (UniqueName: \"kubernetes.io/projected/a7f3887b-6db3-4b15-9874-8403eed85250-kube-api-access-6nh98\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.119982 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.119911 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7db8c4c-f98f-4446-be03-ccce318d5563-cert\") pod \"ingress-canary-s9hcc\" (UID: \"d7db8c4c-f98f-4446-be03-ccce318d5563\") " pod="openshift-ingress-canary/ingress-canary-s9hcc" Jul 29 16:51:33.119982 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.119934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f3887b-6db3-4b15-9874-8403eed85250-tmp-dir\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.119982 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.119958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-installation-pull-secrets\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.120267 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.120000 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-certificates\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.120267 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.120032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhzjm\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-kube-api-access-jhzjm\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.120267 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.120071 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cnl9\" (UniqueName: \"kubernetes.io/projected/d7db8c4c-f98f-4446-be03-ccce318d5563-kube-api-access-4cnl9\") pod \"ingress-canary-s9hcc\" (UID: \"d7db8c4c-f98f-4446-be03-ccce318d5563\") " pod="openshift-ingress-canary/ingress-canary-s9hcc" Jul 29 16:51:33.120267 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.120092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-image-registry-private-configuration\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.120267 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.120113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.120267 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.120146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-ca-trust-extracted\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.120267 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.120172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-trusted-ca\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.120619 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.120597 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:33.120705 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.120620 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f954dbcf-hc7tx: secret "image-registry-tls" not found Jul 29 16:51:33.120705 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.120693 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls podName:4fa45b4d-6f7c-4f8b-bf00-e5de0543df45 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:33.620673244 +0000 UTC m=+36.583746142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls") pod "image-registry-78f954dbcf-hc7tx" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45") : secret "image-registry-tls" not found Jul 29 16:51:33.120997 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.120975 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:33.121098 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.121035 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls podName:a7f3887b-6db3-4b15-9874-8403eed85250 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:33.621016148 +0000 UTC m=+36.584089039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls") pod "dns-default-9w5dd" (UID: "a7f3887b-6db3-4b15-9874-8403eed85250") : secret "dns-default-metrics-tls" not found Jul 29 16:51:33.121098 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.121069 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-ca-trust-extracted\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.121207 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.121179 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-trusted-ca\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.121351 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.121331 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a7f3887b-6db3-4b15-9874-8403eed85250-config-volume\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.121573 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.121550 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f3887b-6db3-4b15-9874-8403eed85250-tmp-dir\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.121948 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.121922 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-certificates\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.124642 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.124622 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-image-registry-private-configuration\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.124717 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.124624 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-installation-pull-secrets\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.124717 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.124690 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7db8c4c-f98f-4446-be03-ccce318d5563-cert\") pod \"ingress-canary-s9hcc\" (UID: \"d7db8c4c-f98f-4446-be03-ccce318d5563\") " pod="openshift-ingress-canary/ingress-canary-s9hcc" Jul 29 16:51:33.129696 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.129660 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhzjm\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-kube-api-access-jhzjm\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.129785 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.129713 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cnl9\" (UniqueName: \"kubernetes.io/projected/d7db8c4c-f98f-4446-be03-ccce318d5563-kube-api-access-4cnl9\") pod \"ingress-canary-s9hcc\" (UID: \"d7db8c4c-f98f-4446-be03-ccce318d5563\") " pod="openshift-ingress-canary/ingress-canary-s9hcc" Jul 29 16:51:33.129785 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.129721 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nh98\" (UniqueName: \"kubernetes.io/projected/a7f3887b-6db3-4b15-9874-8403eed85250-kube-api-access-6nh98\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.130350 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.130331 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-bound-sa-token\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.249732 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.249701 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9hcc" Jul 29 16:51:33.624608 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.624573 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:33.625030 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.624651 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:33.625030 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.624749 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:33.625030 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.624763 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:33.625030 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.624772 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f954dbcf-hc7tx: secret "image-registry-tls" not found Jul 29 16:51:33.625030 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.624827 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls podName:a7f3887b-6db3-4b15-9874-8403eed85250 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:34.624808978 +0000 UTC m=+37.587881876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls") pod "dns-default-9w5dd" (UID: "a7f3887b-6db3-4b15-9874-8403eed85250") : secret "dns-default-metrics-tls" not found Jul 29 16:51:33.625030 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:33.624841 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls podName:4fa45b4d-6f7c-4f8b-bf00-e5de0543df45 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:34.624835195 +0000 UTC m=+37.587908072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls") pod "image-registry-78f954dbcf-hc7tx" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45") : secret "image-registry-tls" not found Jul 29 16:51:33.915823 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:33.915626 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9hcc"] Jul 29 16:51:33.991655 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:51:33.991630 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7db8c4c_f98f_4446_be03_ccce318d5563.slice/crio-f1d1436e32a255dd5c4f8f3023274665136dbc9a24d9bdf4c87f167d013ecc1c WatchSource:0}: Error finding container f1d1436e32a255dd5c4f8f3023274665136dbc9a24d9bdf4c87f167d013ecc1c: Status 404 returned error can't find the container with id f1d1436e32a255dd5c4f8f3023274665136dbc9a24d9bdf4c87f167d013ecc1c Jul 29 16:51:34.528166 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.528122 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:51:34.528318 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.528123 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:51:34.528385 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.528123 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:51:34.531039 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.531020 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 16:51:34.532027 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.532014 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 16:51:34.532094 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.532029 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 16:51:34.532292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.532275 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 16:51:34.532332 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.532281 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ml9hb\"" Jul 29 16:51:34.532332 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.532285 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vc7v9\"" Jul 29 16:51:34.632854 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.632829 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:34.633466 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.632888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:34.633466 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:34.632981 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:34.633466 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:34.632995 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f954dbcf-hc7tx: secret "image-registry-tls" not found Jul 29 16:51:34.633466 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:34.633007 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:34.633466 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:34.633070 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls podName:a7f3887b-6db3-4b15-9874-8403eed85250 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:36.633034113 +0000 UTC m=+39.596107002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls") pod "dns-default-9w5dd" (UID: "a7f3887b-6db3-4b15-9874-8403eed85250") : secret "dns-default-metrics-tls" not found Jul 29 16:51:34.633466 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:34.633086 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls podName:4fa45b4d-6f7c-4f8b-bf00-e5de0543df45 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:36.633077738 +0000 UTC m=+39.596150618 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls") pod "image-registry-78f954dbcf-hc7tx" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45") : secret "image-registry-tls" not found Jul 29 16:51:34.689871 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.689848 2556 generic.go:356] "Generic (PLEG): container finished" podID="3374b880-ecef-4909-b431-070b77a83283" containerID="d565b238e2d815083be1444c67734da9b8e6f89bb737e91123bb51afd1a173e7" exitCode=0 Jul 29 16:51:34.689976 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.689917 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w22hn" event={"ID":"3374b880-ecef-4909-b431-070b77a83283","Type":"ContainerDied","Data":"d565b238e2d815083be1444c67734da9b8e6f89bb737e91123bb51afd1a173e7"} Jul 29 16:51:34.691082 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:34.691061 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9hcc" event={"ID":"d7db8c4c-f98f-4446-be03-ccce318d5563","Type":"ContainerStarted","Data":"f1d1436e32a255dd5c4f8f3023274665136dbc9a24d9bdf4c87f167d013ecc1c"} Jul 29 16:51:35.696116 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:35.696081 2556 generic.go:356] "Generic (PLEG): container finished" podID="3374b880-ecef-4909-b431-070b77a83283" containerID="6830ab3f9ea11c3087462dbb4cc4fd64e898d48540d250199742f2aecc9312a7" exitCode=0 Jul 29 16:51:35.696546 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:35.696163 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w22hn" event={"ID":"3374b880-ecef-4909-b431-070b77a83283","Type":"ContainerDied","Data":"6830ab3f9ea11c3087462dbb4cc4fd64e898d48540d250199742f2aecc9312a7"} Jul 29 16:51:36.647106 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:36.646907 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:36.647283 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:36.647115 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:36.647283 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:36.647140 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f954dbcf-hc7tx: secret "image-registry-tls" not found Jul 29 16:51:36.647283 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:36.647177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:36.647283 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:36.647210 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls podName:4fa45b4d-6f7c-4f8b-bf00-e5de0543df45 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:40.647187731 +0000 UTC m=+43.610260629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls") pod "image-registry-78f954dbcf-hc7tx" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45") : secret "image-registry-tls" not found Jul 29 16:51:36.647283 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:36.647261 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:36.647534 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:36.647311 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls podName:a7f3887b-6db3-4b15-9874-8403eed85250 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:40.647298009 +0000 UTC m=+43.610370903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls") pod "dns-default-9w5dd" (UID: "a7f3887b-6db3-4b15-9874-8403eed85250") : secret "dns-default-metrics-tls" not found Jul 29 16:51:36.702687 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:36.702649 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w22hn" event={"ID":"3374b880-ecef-4909-b431-070b77a83283","Type":"ContainerStarted","Data":"73f2f77e672a92678950f3b549aeabda55a5d2b7beb90e8dd917ce788bacfa24"} Jul 29 16:51:36.727531 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:36.727479 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w22hn" podStartSLOduration=7.928954702 podStartE2EDuration="38.727461422s" totalImagesPullingTime="30.79850672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:36.726401214 +0000 UTC m=+39.689474116" watchObservedRunningTime="2026-07-29 16:51:36.727461422 +0000 UTC m=+39.690534322" Jul 29 16:51:37.709128 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:37.709096 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9hcc" event={"ID":"d7db8c4c-f98f-4446-be03-ccce318d5563","Type":"ContainerStarted","Data":"a59a73b5d52f7eac231d221d1225df07667e4fc9b125bb1a7c6c51b0082661e5"} Jul 29 16:51:37.726866 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:37.726817 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s9hcc" podStartSLOduration=2.116090412 podStartE2EDuration="5.726801641s" totalImagesPullingTime="3.610711229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:37.725611484 +0000 UTC m=+40.688684383" watchObservedRunningTime="2026-07-29 16:51:37.726801641 +0000 UTC m=+40.689874540" Jul 29 16:51:40.677992 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:40.677956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:40.678416 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:40.678021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:40.678416 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:40.678132 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:40.678416 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:40.678148 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:40.678416 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:40.678172 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f954dbcf-hc7tx: secret "image-registry-tls" not found Jul 29 16:51:40.678416 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:40.678182 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls podName:a7f3887b-6db3-4b15-9874-8403eed85250 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:48.678168192 +0000 UTC m=+51.641241069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls") pod "dns-default-9w5dd" (UID: "a7f3887b-6db3-4b15-9874-8403eed85250") : secret "dns-default-metrics-tls" not found Jul 29 16:51:40.678416 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:40.678224 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls podName:4fa45b4d-6f7c-4f8b-bf00-e5de0543df45 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:48.678207911 +0000 UTC m=+51.641280794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls") pod "image-registry-78f954dbcf-hc7tx" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45") : secret "image-registry-tls" not found Jul 29 16:51:48.735947 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:48.735916 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:51:48.736424 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:48.735986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:51:48.736424 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:48.736085 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:48.736424 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:48.736100 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f954dbcf-hc7tx: secret "image-registry-tls" not found Jul 29 16:51:48.736424 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:48.736108 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:48.736424 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:48.736158 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls podName:4fa45b4d-6f7c-4f8b-bf00-e5de0543df45 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:04.736142189 +0000 UTC m=+67.699215071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls") pod "image-registry-78f954dbcf-hc7tx" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45") : secret "image-registry-tls" not found Jul 29 16:51:48.736424 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:48.736171 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls podName:a7f3887b-6db3-4b15-9874-8403eed85250 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:04.736166044 +0000 UTC m=+67.699238920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls") pod "dns-default-9w5dd" (UID: "a7f3887b-6db3-4b15-9874-8403eed85250") : secret "dns-default-metrics-tls" not found Jul 29 16:51:51.150228 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.150193 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg"] Jul 29 16:51:51.167790 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.167767 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:51.170771 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.170739 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 29 16:51:51.170892 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.170809 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:51:51.171634 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.171615 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jjlh2\"" Jul 29 16:51:51.171745 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.171621 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 29 16:51:51.180009 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.179990 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg"] Jul 29 16:51:51.256192 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.256169 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dss4c\" (UniqueName: \"kubernetes.io/projected/24353282-0cf1-40cf-9e43-a602631abead-kube-api-access-dss4c\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:51.256320 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.256217 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:51.355409 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.355380 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-mx49x"] Jul 29 16:51:51.356860 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.356838 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:51.356956 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.356912 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dss4c\" (UniqueName: \"kubernetes.io/projected/24353282-0cf1-40cf-9e43-a602631abead-kube-api-access-dss4c\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:51.357004 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:51.356989 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 16:51:51.357078 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:51.357067 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls podName:24353282-0cf1-40cf-9e43-a602631abead nodeName:}" failed. No retries permitted until 2026-07-29 16:51:51.857036934 +0000 UTC m=+54.820109833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls") pod "cluster-samples-operator-6748489656-bk7qg" (UID: "24353282-0cf1-40cf-9e43-a602631abead") : secret "samples-operator-tls" not found Jul 29 16:51:51.377543 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.377524 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fg92r"] Jul 29 16:51:51.378075 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.377625 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.383235 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.383213 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bn25s\"" Jul 29 16:51:51.383503 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.383487 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 29 16:51:51.384030 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.384013 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 29 16:51:51.384113 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.384019 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 29 16:51:51.384306 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.384290 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:51:51.388295 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.388278 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dss4c\" (UniqueName: \"kubernetes.io/projected/24353282-0cf1-40cf-9e43-a602631abead-kube-api-access-dss4c\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:51.393835 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.393728 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fg92r"] Jul 29 16:51:51.393835 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.393789 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-mx49x"] Jul 29 16:51:51.397175 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.394133 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:51.397175 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.399333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hmqq5\"" Jul 29 16:51:51.397175 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.399589 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 16:51:51.397175 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.399798 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 29 16:51:51.397175 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.400089 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 16:51:51.558784 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.558759 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-config\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.558937 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.558798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-serving-cert\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.558937 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.558816 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:51.558937 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.558877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:51.558937 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.558909 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwdjt\" (UniqueName: \"kubernetes.io/projected/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-kube-api-access-pwdjt\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.559086 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.558961 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-trusted-ca\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.659858 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.659830 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-serving-cert\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.659858 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.659858 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:51.660012 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.659885 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:51.660012 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.659905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwdjt\" (UniqueName: \"kubernetes.io/projected/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-kube-api-access-pwdjt\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.660012 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.659937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-trusted-ca\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.660012 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:51.659995 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 16:51:51.660216 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.660021 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-config\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.660216 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:51.660092 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert podName:0a2e138a-a125-4228-bf87-42e2fc3c8ff3 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:52.160069887 +0000 UTC m=+55.123142767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fg92r" (UID: "0a2e138a-a125-4228-bf87-42e2fc3c8ff3") : secret "networking-console-plugin-cert" not found Jul 29 16:51:51.660632 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.660605 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:51.660739 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.660607 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-config\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.660739 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.660730 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-trusted-ca\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.662103 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.662086 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-serving-cert\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.671619 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.671574 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwdjt\" (UniqueName: \"kubernetes.io/projected/d2cf8659-9476-4e48-9e1a-ead4225fe5ed-kube-api-access-pwdjt\") pod \"console-operator-584dcb6b54-mx49x\" (UID: \"d2cf8659-9476-4e48-9e1a-ead4225fe5ed\") " pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.687460 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.687443 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:51:51.849076 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.849035 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-mx49x"] Jul 29 16:51:51.852252 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:51:51.852230 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2cf8659_9476_4e48_9e1a_ead4225fe5ed.slice/crio-9e0990f6804715d7d05e39d8cdd70b620593a54f0206c67fb34364ccb6bd6f55 WatchSource:0}: Error finding container 9e0990f6804715d7d05e39d8cdd70b620593a54f0206c67fb34364ccb6bd6f55: Status 404 returned error can't find the container with id 9e0990f6804715d7d05e39d8cdd70b620593a54f0206c67fb34364ccb6bd6f55 Jul 29 16:51:51.861165 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:51.861141 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:51.861304 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:51.861290 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 16:51:51.861363 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:51.861354 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls podName:24353282-0cf1-40cf-9e43-a602631abead nodeName:}" failed. No retries permitted until 2026-07-29 16:51:52.861336671 +0000 UTC m=+55.824409570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls") pod "cluster-samples-operator-6748489656-bk7qg" (UID: "24353282-0cf1-40cf-9e43-a602631abead") : secret "samples-operator-tls" not found Jul 29 16:51:52.163665 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:52.163630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:52.164032 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:52.163782 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 16:51:52.164032 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:52.163847 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert podName:0a2e138a-a125-4228-bf87-42e2fc3c8ff3 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:53.163831386 +0000 UTC m=+56.126904268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fg92r" (UID: "0a2e138a-a125-4228-bf87-42e2fc3c8ff3") : secret "networking-console-plugin-cert" not found Jul 29 16:51:52.744845 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:52.744764 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" event={"ID":"d2cf8659-9476-4e48-9e1a-ead4225fe5ed","Type":"ContainerStarted","Data":"9e0990f6804715d7d05e39d8cdd70b620593a54f0206c67fb34364ccb6bd6f55"} Jul 29 16:51:52.869372 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:52.869339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:52.869554 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:52.869510 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 16:51:52.869620 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:52.869592 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls podName:24353282-0cf1-40cf-9e43-a602631abead nodeName:}" failed. No retries permitted until 2026-07-29 16:51:54.869572004 +0000 UTC m=+57.832644895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls") pod "cluster-samples-operator-6748489656-bk7qg" (UID: "24353282-0cf1-40cf-9e43-a602631abead") : secret "samples-operator-tls" not found Jul 29 16:51:53.172208 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:53.172135 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:53.172587 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:53.172254 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 16:51:53.172587 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:53.172334 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert podName:0a2e138a-a125-4228-bf87-42e2fc3c8ff3 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:55.172316398 +0000 UTC m=+58.135389274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fg92r" (UID: "0a2e138a-a125-4228-bf87-42e2fc3c8ff3") : secret "networking-console-plugin-cert" not found Jul 29 16:51:54.750848 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:54.750819 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/0.log" Jul 29 16:51:54.751242 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:54.750857 2556 generic.go:356] "Generic (PLEG): container finished" podID="d2cf8659-9476-4e48-9e1a-ead4225fe5ed" containerID="2a6f0498e285077d3968744513f2269b62d212faa90d759ce0d945455990dd90" exitCode=255 Jul 29 16:51:54.751242 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:54.750914 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" event={"ID":"d2cf8659-9476-4e48-9e1a-ead4225fe5ed","Type":"ContainerDied","Data":"2a6f0498e285077d3968744513f2269b62d212faa90d759ce0d945455990dd90"} Jul 29 16:51:54.751242 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:54.751130 2556 scope.go:117] "RemoveContainer" containerID="2a6f0498e285077d3968744513f2269b62d212faa90d759ce0d945455990dd90" Jul 29 16:51:54.885032 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:54.885007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:54.885186 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:54.885168 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 16:51:54.885269 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:54.885240 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls podName:24353282-0cf1-40cf-9e43-a602631abead nodeName:}" failed. No retries permitted until 2026-07-29 16:51:58.885219768 +0000 UTC m=+61.848292667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls") pod "cluster-samples-operator-6748489656-bk7qg" (UID: "24353282-0cf1-40cf-9e43-a602631abead") : secret "samples-operator-tls" not found Jul 29 16:51:55.187272 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:55.187194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:55.187402 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:55.187331 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 16:51:55.187402 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:55.187391 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert podName:0a2e138a-a125-4228-bf87-42e2fc3c8ff3 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:59.18737638 +0000 UTC m=+62.150449258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fg92r" (UID: "0a2e138a-a125-4228-bf87-42e2fc3c8ff3") : secret "networking-console-plugin-cert" not found Jul 29 16:51:55.754513 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:55.754488 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/1.log" Jul 29 16:51:55.754904 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:55.754888 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/0.log" Jul 29 16:51:55.754947 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:55.754924 2556 generic.go:356] "Generic (PLEG): container finished" podID="d2cf8659-9476-4e48-9e1a-ead4225fe5ed" containerID="b230f9c3c0872a359ca13c5239e94d5a9716b75905fa7b672bca3dda910a001d" exitCode=255 Jul 29 16:51:55.754988 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:55.754974 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" event={"ID":"d2cf8659-9476-4e48-9e1a-ead4225fe5ed","Type":"ContainerDied","Data":"b230f9c3c0872a359ca13c5239e94d5a9716b75905fa7b672bca3dda910a001d"} Jul 29 16:51:55.755041 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:55.755031 2556 scope.go:117] "RemoveContainer" containerID="2a6f0498e285077d3968744513f2269b62d212faa90d759ce0d945455990dd90" Jul 29 16:51:55.755217 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:55.755200 2556 scope.go:117] "RemoveContainer" containerID="b230f9c3c0872a359ca13c5239e94d5a9716b75905fa7b672bca3dda910a001d" Jul 29 16:51:55.755388 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:55.755368 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-mx49x_openshift-console-operator(d2cf8659-9476-4e48-9e1a-ead4225fe5ed)\"" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" podUID="d2cf8659-9476-4e48-9e1a-ead4225fe5ed" Jul 29 16:51:56.759028 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:56.759002 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/1.log" Jul 29 16:51:56.759415 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:56.759334 2556 scope.go:117] "RemoveContainer" containerID="b230f9c3c0872a359ca13c5239e94d5a9716b75905fa7b672bca3dda910a001d" Jul 29 16:51:56.759493 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:56.759473 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-mx49x_openshift-console-operator(d2cf8659-9476-4e48-9e1a-ead4225fe5ed)\"" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" podUID="d2cf8659-9476-4e48-9e1a-ead4225fe5ed" Jul 29 16:51:57.677441 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:57.677409 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v9xpq" Jul 29 16:51:58.914388 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:58.914357 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:51:58.914757 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:58.914499 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 29 16:51:58.914757 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:58.914563 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls podName:24353282-0cf1-40cf-9e43-a602631abead nodeName:}" failed. No retries permitted until 2026-07-29 16:52:06.914545973 +0000 UTC m=+69.877618865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls") pod "cluster-samples-operator-6748489656-bk7qg" (UID: "24353282-0cf1-40cf-9e43-a602631abead") : secret "samples-operator-tls" not found Jul 29 16:51:59.217000 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:51:59.216977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:51:59.217164 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:59.217131 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 16:51:59.217206 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:51:59.217191 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert podName:0a2e138a-a125-4228-bf87-42e2fc3c8ff3 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:07.217176951 +0000 UTC m=+70.180249827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fg92r" (UID: "0a2e138a-a125-4228-bf87-42e2fc3c8ff3") : secret "networking-console-plugin-cert" not found Jul 29 16:52:01.687565 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:01.687534 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:52:01.688010 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:01.687583 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:52:01.688010 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:01.687881 2556 scope.go:117] "RemoveContainer" containerID="b230f9c3c0872a359ca13c5239e94d5a9716b75905fa7b672bca3dda910a001d" Jul 29 16:52:01.688119 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:01.688010 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-mx49x_openshift-console-operator(d2cf8659-9476-4e48-9e1a-ead4225fe5ed)\"" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" podUID="d2cf8659-9476-4e48-9e1a-ead4225fe5ed" Jul 29 16:52:01.843763 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:01.843734 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ld22h_5617951d-8f28-45a2-a22b-fcd4e7477040/dns-node-resolver/0.log" Jul 29 16:52:02.642979 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:02.642951 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8n58r_74dc9130-9427-43e2-a44a-ce0c2fd928e6/node-ca/0.log" Jul 29 16:52:03.247875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.247848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:52:03.250802 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.250784 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 16:52:03.258438 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:03.258419 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 16:52:03.258524 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:03.258472 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs podName:1da775fc-ac1d-4a60-89cc-c18daa86454c nodeName:}" failed. No retries permitted until 2026-07-29 16:53:07.258455427 +0000 UTC m=+130.221528305 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs") pod "network-metrics-daemon-s29ts" (UID: "1da775fc-ac1d-4a60-89cc-c18daa86454c") : secret "metrics-daemon-secret" not found Jul 29 16:52:03.348302 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.348271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:52:03.351205 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.351190 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 16:52:03.361301 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.361277 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/589260e8-5438-419f-b665-7e36b674bb99-original-pull-secret\") pod \"global-pull-secret-syncer-77lxz\" (UID: \"589260e8-5438-419f-b665-7e36b674bb99\") " pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:52:03.449567 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.449533 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:52:03.452589 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.452571 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 16:52:03.463062 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.463027 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 16:52:03.473592 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.473566 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9mt9\" (UniqueName: \"kubernetes.io/projected/2df87625-a6b8-4739-876f-a39cc90be9af-kube-api-access-x9mt9\") pod \"network-check-target-dng5h\" (UID: \"2df87625-a6b8-4739-876f-a39cc90be9af\") " pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:52:03.645666 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.645586 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ml9hb\"" Jul 29 16:52:03.647957 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.647937 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-77lxz" Jul 29 16:52:03.653499 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.653476 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:52:03.778670 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.778643 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-77lxz"] Jul 29 16:52:03.781695 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:03.781672 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589260e8_5438_419f_b665_7e36b674bb99.slice/crio-7889591a7cb507422600a21f38b33698269756eb08a1fd4fb0b5a0cfc2c0e492 WatchSource:0}: Error finding container 7889591a7cb507422600a21f38b33698269756eb08a1fd4fb0b5a0cfc2c0e492: Status 404 returned error can't find the container with id 7889591a7cb507422600a21f38b33698269756eb08a1fd4fb0b5a0cfc2c0e492 Jul 29 16:52:03.795998 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.795979 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dng5h"] Jul 29 16:52:03.798100 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:03.798080 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df87625_a6b8_4739_876f_a39cc90be9af.slice/crio-7afd62c954d1fb0e4fa594bc2af952b2890ecc26e94fca45ac2478270fced016 WatchSource:0}: Error finding container 7afd62c954d1fb0e4fa594bc2af952b2890ecc26e94fca45ac2478270fced016: Status 404 returned error can't find the container with id 7afd62c954d1fb0e4fa594bc2af952b2890ecc26e94fca45ac2478270fced016 Jul 29 16:52:03.843999 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:03.843981 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9hcc_d7db8c4c-f98f-4446-be03-ccce318d5563/serve-healthcheck-canary/0.log" Jul 29 16:52:04.759921 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:04.759883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:52:04.760407 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:04.759949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:52:04.760407 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:04.760040 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:52:04.760407 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:04.760072 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78f954dbcf-hc7tx: secret "image-registry-tls" not found Jul 29 16:52:04.760407 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:04.760038 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:52:04.760407 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:04.760136 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls podName:4fa45b4d-6f7c-4f8b-bf00-e5de0543df45 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:36.760114969 +0000 UTC m=+99.723187856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls") pod "image-registry-78f954dbcf-hc7tx" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45") : secret "image-registry-tls" not found Jul 29 16:52:04.760407 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:04.760152 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls podName:a7f3887b-6db3-4b15-9874-8403eed85250 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:36.760145987 +0000 UTC m=+99.723218864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls") pod "dns-default-9w5dd" (UID: "a7f3887b-6db3-4b15-9874-8403eed85250") : secret "dns-default-metrics-tls" not found Jul 29 16:52:04.779770 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:04.779740 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dng5h" event={"ID":"2df87625-a6b8-4739-876f-a39cc90be9af","Type":"ContainerStarted","Data":"7afd62c954d1fb0e4fa594bc2af952b2890ecc26e94fca45ac2478270fced016"} Jul 29 16:52:04.780811 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:04.780780 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-77lxz" event={"ID":"589260e8-5438-419f-b665-7e36b674bb99","Type":"ContainerStarted","Data":"7889591a7cb507422600a21f38b33698269756eb08a1fd4fb0b5a0cfc2c0e492"} Jul 29 16:52:06.981625 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:06.981589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:52:06.984294 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:06.984265 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/24353282-0cf1-40cf-9e43-a602631abead-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-bk7qg\" (UID: \"24353282-0cf1-40cf-9e43-a602631abead\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:52:07.078652 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:07.078622 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jjlh2\"" Jul 29 16:52:07.086645 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:07.086616 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" Jul 29 16:52:07.283913 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:07.283816 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:52:07.284094 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:07.283983 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 16:52:07.284094 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:07.284080 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert podName:0a2e138a-a125-4228-bf87-42e2fc3c8ff3 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:23.284059155 +0000 UTC m=+86.247132046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fg92r" (UID: "0a2e138a-a125-4228-bf87-42e2fc3c8ff3") : secret "networking-console-plugin-cert" not found Jul 29 16:52:08.825523 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:08.825492 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg"] Jul 29 16:52:09.796089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:09.796036 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dng5h" event={"ID":"2df87625-a6b8-4739-876f-a39cc90be9af","Type":"ContainerStarted","Data":"3894a04c85d7bcc3f6ad80a968291e1b7c36d14a216ef116a19452ce58d9bbde"} Jul 29 16:52:09.796268 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:09.796138 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:52:09.797960 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:09.797930 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-77lxz" event={"ID":"589260e8-5438-419f-b665-7e36b674bb99","Type":"ContainerStarted","Data":"d1dd48cbf8f92a7dfa0f34d31b072d578fb119f29c92c0cbf120466c474bb729"} Jul 29 16:52:09.799182 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:09.799158 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" event={"ID":"24353282-0cf1-40cf-9e43-a602631abead","Type":"ContainerStarted","Data":"66962b752f120e6cdae25a2e07e96c9ab6e87ae2fa041cd5f13d1934719d6d21"} Jul 29 16:52:09.816132 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:09.816075 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dng5h" podStartSLOduration=66.92131304 podStartE2EDuration="1m11.816043563s" totalImagesPullingTime="4.894730523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:09.814117178 +0000 UTC m=+72.777190077" watchObservedRunningTime="2026-07-29 16:52:09.816043563 +0000 UTC m=+72.779116463" Jul 29 16:52:09.832012 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:09.831970 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-77lxz" podStartSLOduration=66.904191958 podStartE2EDuration="1m11.831957338s" totalImagesPullingTime="4.92776538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:09.831440825 +0000 UTC m=+72.794513727" watchObservedRunningTime="2026-07-29 16:52:09.831957338 +0000 UTC m=+72.795030237" Jul 29 16:52:10.807985 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:10.807897 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" event={"ID":"24353282-0cf1-40cf-9e43-a602631abead","Type":"ContainerStarted","Data":"cc512d55a9e788b527451bb7409eaf39fde163dc75cf6a4344c299161ec0b748"} Jul 29 16:52:10.808149 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:10.807992 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" event={"ID":"24353282-0cf1-40cf-9e43-a602631abead","Type":"ContainerStarted","Data":"47b361766322693b21ee8f668ae8a58201476cda51a68d0dc8df9cdcb1a1d3ba"} Jul 29 16:52:15.528449 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:15.528415 2556 scope.go:117] "RemoveContainer" containerID="b230f9c3c0872a359ca13c5239e94d5a9716b75905fa7b672bca3dda910a001d" Jul 29 16:52:15.823757 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:15.823682 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 16:52:15.824100 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:15.824085 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/1.log" Jul 29 16:52:15.824144 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:15.824120 2556 generic.go:356] "Generic (PLEG): container finished" podID="d2cf8659-9476-4e48-9e1a-ead4225fe5ed" containerID="620797d8ffa7f92d5295ec69775fff4dba701c105d60733e4249717f8f4dd4d9" exitCode=255 Jul 29 16:52:15.824182 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:15.824173 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" event={"ID":"d2cf8659-9476-4e48-9e1a-ead4225fe5ed","Type":"ContainerDied","Data":"620797d8ffa7f92d5295ec69775fff4dba701c105d60733e4249717f8f4dd4d9"} Jul 29 16:52:15.824229 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:15.824219 2556 scope.go:117] "RemoveContainer" containerID="b230f9c3c0872a359ca13c5239e94d5a9716b75905fa7b672bca3dda910a001d" Jul 29 16:52:15.824543 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:15.824515 2556 scope.go:117] "RemoveContainer" containerID="620797d8ffa7f92d5295ec69775fff4dba701c105d60733e4249717f8f4dd4d9" Jul 29 16:52:15.824727 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:15.824708 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-mx49x_openshift-console-operator(d2cf8659-9476-4e48-9e1a-ead4225fe5ed)\"" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" podUID="d2cf8659-9476-4e48-9e1a-ead4225fe5ed" Jul 29 16:52:15.843469 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:15.843432 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-bk7qg" podStartSLOduration=23.181204131 podStartE2EDuration="24.8434188s" totalImagesPullingTime="1.662214669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:10.832804526 +0000 UTC m=+73.795877422" watchObservedRunningTime="2026-07-29 16:52:15.8434188 +0000 UTC m=+78.806491699" Jul 29 16:52:16.831809 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:16.831780 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 16:52:21.411141 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.411027 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-npw8n"] Jul 29 16:52:21.414222 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.414206 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.420210 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.420184 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 16:52:21.421144 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.421125 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 16:52:21.421226 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.421149 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 16:52:21.421361 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.421349 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdf6g\"" Jul 29 16:52:21.421394 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.421351 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 16:52:21.443947 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.443923 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npw8n"] Jul 29 16:52:21.486986 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.486962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1b494ea-2606-4cdd-9e9a-e9d692866751-data-volume\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.487145 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.487074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1b494ea-2606-4cdd-9e9a-e9d692866751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.487145 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.487107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1b494ea-2606-4cdd-9e9a-e9d692866751-crio-socket\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.487145 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.487132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c48h\" (UniqueName: \"kubernetes.io/projected/d1b494ea-2606-4cdd-9e9a-e9d692866751-kube-api-access-6c48h\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.487285 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.487209 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1b494ea-2606-4cdd-9e9a-e9d692866751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.506692 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.506666 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q"] Jul 29 16:52:21.509520 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.509504 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" Jul 29 16:52:21.515154 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.515135 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 16:52:21.515394 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.515269 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 16:52:21.515394 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.515343 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 29 16:52:21.515509 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.515450 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 16:52:21.515838 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.515822 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t9r9k\"" Jul 29 16:52:21.549386 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.549367 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q"] Jul 29 16:52:21.588403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588374 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1b494ea-2606-4cdd-9e9a-e9d692866751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.588518 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588410 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1b494ea-2606-4cdd-9e9a-e9d692866751-data-volume\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.588518 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkvrc\" (UniqueName: \"kubernetes.io/projected/db4ab7d9-fb82-4c29-9753-7531ade75af3-kube-api-access-lkvrc\") pod \"managed-serviceaccount-addon-agent-56cf7c5896-d589q\" (UID: \"db4ab7d9-fb82-4c29-9753-7531ade75af3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" Jul 29 16:52:21.588518 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588501 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1b494ea-2606-4cdd-9e9a-e9d692866751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.588658 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1b494ea-2606-4cdd-9e9a-e9d692866751-crio-socket\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.588658 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588582 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c48h\" (UniqueName: \"kubernetes.io/projected/d1b494ea-2606-4cdd-9e9a-e9d692866751-kube-api-access-6c48h\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.588658 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db4ab7d9-fb82-4c29-9753-7531ade75af3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56cf7c5896-d589q\" (UID: \"db4ab7d9-fb82-4c29-9753-7531ade75af3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" Jul 29 16:52:21.588803 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588651 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d1b494ea-2606-4cdd-9e9a-e9d692866751-crio-socket\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.588803 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588744 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d1b494ea-2606-4cdd-9e9a-e9d692866751-data-volume\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.588901 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.588872 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d1b494ea-2606-4cdd-9e9a-e9d692866751-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.590768 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.590748 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d1b494ea-2606-4cdd-9e9a-e9d692866751-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.610243 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.610221 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs"] Jul 29 16:52:21.613324 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.613311 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" Jul 29 16:52:21.617245 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.617229 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 29 16:52:21.617354 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.617262 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 29 16:52:21.617354 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.617270 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ckt5g\"" Jul 29 16:52:21.624682 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.624665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c48h\" (UniqueName: \"kubernetes.io/projected/d1b494ea-2606-4cdd-9e9a-e9d692866751-kube-api-access-6c48h\") pod \"insights-runtime-extractor-npw8n\" (UID: \"d1b494ea-2606-4cdd-9e9a-e9d692866751\") " pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.635350 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.635326 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs"] Jul 29 16:52:21.687824 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.687772 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:52:21.687824 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.687816 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:52:21.688125 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.688113 2556 scope.go:117] "RemoveContainer" containerID="620797d8ffa7f92d5295ec69775fff4dba701c105d60733e4249717f8f4dd4d9" Jul 29 16:52:21.688295 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:21.688270 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-mx49x_openshift-console-operator(d2cf8659-9476-4e48-9e1a-ead4225fe5ed)\"" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" podUID="d2cf8659-9476-4e48-9e1a-ead4225fe5ed" Jul 29 16:52:21.689294 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.689276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cjbb\" (UniqueName: \"kubernetes.io/projected/f45bd424-3f53-4d9c-a97e-a6cc07c5234c-kube-api-access-5cjbb\") pod \"migrator-6865c9967-hhkqs\" (UID: \"f45bd424-3f53-4d9c-a97e-a6cc07c5234c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" Jul 29 16:52:21.689361 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.689312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db4ab7d9-fb82-4c29-9753-7531ade75af3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56cf7c5896-d589q\" (UID: \"db4ab7d9-fb82-4c29-9753-7531ade75af3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" Jul 29 16:52:21.689361 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.689342 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkvrc\" (UniqueName: \"kubernetes.io/projected/db4ab7d9-fb82-4c29-9753-7531ade75af3-kube-api-access-lkvrc\") pod \"managed-serviceaccount-addon-agent-56cf7c5896-d589q\" (UID: \"db4ab7d9-fb82-4c29-9753-7531ade75af3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" Jul 29 16:52:21.691658 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.691635 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/db4ab7d9-fb82-4c29-9753-7531ade75af3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56cf7c5896-d589q\" (UID: \"db4ab7d9-fb82-4c29-9753-7531ade75af3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" Jul 29 16:52:21.711192 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.711173 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkvrc\" (UniqueName: \"kubernetes.io/projected/db4ab7d9-fb82-4c29-9753-7531ade75af3-kube-api-access-lkvrc\") pod \"managed-serviceaccount-addon-agent-56cf7c5896-d589q\" (UID: \"db4ab7d9-fb82-4c29-9753-7531ade75af3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" Jul 29 16:52:21.725108 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.725075 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-npw8n" Jul 29 16:52:21.790350 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.790326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cjbb\" (UniqueName: \"kubernetes.io/projected/f45bd424-3f53-4d9c-a97e-a6cc07c5234c-kube-api-access-5cjbb\") pod \"migrator-6865c9967-hhkqs\" (UID: \"f45bd424-3f53-4d9c-a97e-a6cc07c5234c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" Jul 29 16:52:21.804795 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:21.804771 2556 projected.go:291] Couldn't get configMap openshift-kube-storage-version-migrator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found Jul 29 16:52:21.804795 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:21.804797 2556 projected.go:196] Error preparing data for projected volume kube-api-access-5cjbb for pod openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs: configmap "openshift-service-ca.crt" not found Jul 29 16:52:21.804933 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:21.804858 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f45bd424-3f53-4d9c-a97e-a6cc07c5234c-kube-api-access-5cjbb podName:f45bd424-3f53-4d9c-a97e-a6cc07c5234c nodeName:}" failed. No retries permitted until 2026-07-29 16:52:22.304835533 +0000 UTC m=+85.267908425 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5cjbb" (UniqueName: "kubernetes.io/projected/f45bd424-3f53-4d9c-a97e-a6cc07c5234c-kube-api-access-5cjbb") pod "migrator-6865c9967-hhkqs" (UID: "f45bd424-3f53-4d9c-a97e-a6cc07c5234c") : configmap "openshift-service-ca.crt" not found Jul 29 16:52:21.835437 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.835414 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" Jul 29 16:52:21.859763 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.859737 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-npw8n"] Jul 29 16:52:21.863280 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:21.863254 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b494ea_2606_4cdd_9e9a_e9d692866751.slice/crio-c7e2e3264fdabf7e5230e063d7b74870df4d861867bb486db9c55e896d9615f3 WatchSource:0}: Error finding container c7e2e3264fdabf7e5230e063d7b74870df4d861867bb486db9c55e896d9615f3: Status 404 returned error can't find the container with id c7e2e3264fdabf7e5230e063d7b74870df4d861867bb486db9c55e896d9615f3 Jul 29 16:52:21.971391 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:21.971370 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q"] Jul 29 16:52:21.972854 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:21.972833 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb4ab7d9_fb82_4c29_9753_7531ade75af3.slice/crio-02014c0bc7fcca2791868904ab901aca4100775f6d4a899e16a7f17865971803 WatchSource:0}: Error finding container 02014c0bc7fcca2791868904ab901aca4100775f6d4a899e16a7f17865971803: Status 404 returned error can't find the container with id 02014c0bc7fcca2791868904ab901aca4100775f6d4a899e16a7f17865971803 Jul 29 16:52:22.395082 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:22.394984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cjbb\" (UniqueName: \"kubernetes.io/projected/f45bd424-3f53-4d9c-a97e-a6cc07c5234c-kube-api-access-5cjbb\") pod \"migrator-6865c9967-hhkqs\" (UID: \"f45bd424-3f53-4d9c-a97e-a6cc07c5234c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" Jul 29 16:52:22.398252 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:22.398226 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cjbb\" (UniqueName: \"kubernetes.io/projected/f45bd424-3f53-4d9c-a97e-a6cc07c5234c-kube-api-access-5cjbb\") pod \"migrator-6865c9967-hhkqs\" (UID: \"f45bd424-3f53-4d9c-a97e-a6cc07c5234c\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" Jul 29 16:52:22.522615 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:22.522584 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" Jul 29 16:52:22.675386 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:22.675305 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs"] Jul 29 16:52:22.679158 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:22.679124 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45bd424_3f53_4d9c_a97e_a6cc07c5234c.slice/crio-b60e7d614e58864d0767e2415b1c07905060510a0a3a80c565f8f3b61a9f7904 WatchSource:0}: Error finding container b60e7d614e58864d0767e2415b1c07905060510a0a3a80c565f8f3b61a9f7904: Status 404 returned error can't find the container with id b60e7d614e58864d0767e2415b1c07905060510a0a3a80c565f8f3b61a9f7904 Jul 29 16:52:22.851916 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:22.851882 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" event={"ID":"f45bd424-3f53-4d9c-a97e-a6cc07c5234c","Type":"ContainerStarted","Data":"b60e7d614e58864d0767e2415b1c07905060510a0a3a80c565f8f3b61a9f7904"} Jul 29 16:52:22.853239 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:22.853206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" event={"ID":"db4ab7d9-fb82-4c29-9753-7531ade75af3","Type":"ContainerStarted","Data":"02014c0bc7fcca2791868904ab901aca4100775f6d4a899e16a7f17865971803"} Jul 29 16:52:22.854482 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:22.854453 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npw8n" event={"ID":"d1b494ea-2606-4cdd-9e9a-e9d692866751","Type":"ContainerStarted","Data":"c7e2e3264fdabf7e5230e063d7b74870df4d861867bb486db9c55e896d9615f3"} Jul 29 16:52:23.304602 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:23.304565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:52:23.311799 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:23.311772 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a2e138a-a125-4228-bf87-42e2fc3c8ff3-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fg92r\" (UID: \"0a2e138a-a125-4228-bf87-42e2fc3c8ff3\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:52:23.509279 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:23.509246 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hmqq5\"" Jul 29 16:52:23.517976 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:23.517949 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" Jul 29 16:52:23.692209 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:23.692182 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fg92r"] Jul 29 16:52:23.972667 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:23.972634 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2e138a_a125_4228_bf87_42e2fc3c8ff3.slice/crio-853e250d2350ddcfd53838212afb9e44548a0fd579e8da027406d9983462bf80 WatchSource:0}: Error finding container 853e250d2350ddcfd53838212afb9e44548a0fd579e8da027406d9983462bf80: Status 404 returned error can't find the container with id 853e250d2350ddcfd53838212afb9e44548a0fd579e8da027406d9983462bf80 Jul 29 16:52:24.863352 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:24.863315 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" event={"ID":"0a2e138a-a125-4228-bf87-42e2fc3c8ff3","Type":"ContainerStarted","Data":"853e250d2350ddcfd53838212afb9e44548a0fd579e8da027406d9983462bf80"} Jul 29 16:52:28.880738 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:28.880701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" event={"ID":"f45bd424-3f53-4d9c-a97e-a6cc07c5234c","Type":"ContainerStarted","Data":"82563fe4c6f937ec71a0fada1539dd9034a99fe4ff1b8ddf0468e9f9d4ac7189"} Jul 29 16:52:28.881215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:28.880788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" event={"ID":"f45bd424-3f53-4d9c-a97e-a6cc07c5234c","Type":"ContainerStarted","Data":"9f0326222101adc7ea91f01872263375717c99c943e6b2cf58196b94e945ef55"} Jul 29 16:52:28.882034 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:28.882012 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" event={"ID":"db4ab7d9-fb82-4c29-9753-7531ade75af3","Type":"ContainerStarted","Data":"5e55f2bb897b83ab4ce836a4e9bf551da657355814c6eecd2f2f6515682dc04c"} Jul 29 16:52:28.883325 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:28.883305 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npw8n" event={"ID":"d1b494ea-2606-4cdd-9e9a-e9d692866751","Type":"ContainerStarted","Data":"736bd1a3c2e3ddb96db218aa42a493181dee56a7f46121f153125b368044c827"} Jul 29 16:52:28.884657 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:28.884634 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" event={"ID":"0a2e138a-a125-4228-bf87-42e2fc3c8ff3","Type":"ContainerStarted","Data":"56133382301c0a02987b49cd6dad46fea39007616d02c8dc1cb1f044d58be3b5"} Jul 29 16:52:28.898244 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:28.898202 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-hhkqs" podStartSLOduration=2.604844405 podStartE2EDuration="7.898190089s" totalImagesPullingTime="5.293345684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:28.896414546 +0000 UTC m=+91.859487444" watchObservedRunningTime="2026-07-29 16:52:28.898190089 +0000 UTC m=+91.861263013" Jul 29 16:52:28.911816 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:28.911784 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56cf7c5896-d589q" podStartSLOduration=1.911141238 podStartE2EDuration="7.911760558s" totalImagesPullingTime="6.00061932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:28.911156635 +0000 UTC m=+91.874229536" watchObservedRunningTime="2026-07-29 16:52:28.911760558 +0000 UTC m=+91.874833447" Jul 29 16:52:28.929145 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:28.929100 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fg92r" podStartSLOduration=33.876844003 podStartE2EDuration="37.929084326s" totalImagesPullingTime="4.052240323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:28.927857458 +0000 UTC m=+91.890930358" watchObservedRunningTime="2026-07-29 16:52:28.929084326 +0000 UTC m=+91.892157228" Jul 29 16:52:31.896291 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:31.896259 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npw8n" event={"ID":"d1b494ea-2606-4cdd-9e9a-e9d692866751","Type":"ContainerStarted","Data":"8587c7546e5c5ff9006a796a0393062bd23ef4dfbecdfdba157bde3a36861372"} Jul 29 16:52:35.913631 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:35.913595 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-npw8n" event={"ID":"d1b494ea-2606-4cdd-9e9a-e9d692866751","Type":"ContainerStarted","Data":"4d3b5531a25fc275175daaa8908782aec1a12cec94c79a822358bf2767fafc9e"} Jul 29 16:52:35.933620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:35.933574 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-npw8n" podStartSLOduration=1.613183808 podStartE2EDuration="14.933560662s" totalImagesPullingTime="13.320376854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:52:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:35.932418728 +0000 UTC m=+98.895491629" watchObservedRunningTime="2026-07-29 16:52:35.933560662 +0000 UTC m=+98.896633561" Jul 29 16:52:36.528657 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.528632 2556 scope.go:117] "RemoveContainer" containerID="620797d8ffa7f92d5295ec69775fff4dba701c105d60733e4249717f8f4dd4d9" Jul 29 16:52:36.814962 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.814882 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:52:36.814962 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.814931 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:52:36.817179 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.817154 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a7f3887b-6db3-4b15-9874-8403eed85250-metrics-tls\") pod \"dns-default-9w5dd\" (UID: \"a7f3887b-6db3-4b15-9874-8403eed85250\") " pod="openshift-dns/dns-default-9w5dd" Jul 29 16:52:36.817265 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.817221 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"image-registry-78f954dbcf-hc7tx\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:52:36.828972 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.828953 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2pg7b\"" Jul 29 16:52:36.836109 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.836087 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:52:36.836427 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.836413 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p46rx\"" Jul 29 16:52:36.844089 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.844072 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9w5dd" Jul 29 16:52:36.937546 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.937524 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 16:52:36.938095 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.938075 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" event={"ID":"d2cf8659-9476-4e48-9e1a-ead4225fe5ed","Type":"ContainerStarted","Data":"e7cc4127a60a44d404a893cdc8f4f4f24dfe3f33169fa4fdad54ed5975653ab9"} Jul 29 16:52:36.938595 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.938571 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:52:36.957435 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.957284 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" podStartSLOduration=43.885558694 podStartE2EDuration="45.957265782s" totalImagesPullingTime="2.071707088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:36.957005991 +0000 UTC m=+99.920078890" watchObservedRunningTime="2026-07-29 16:52:36.957265782 +0000 UTC m=+99.920338684" Jul 29 16:52:36.995306 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:36.995260 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78f954dbcf-hc7tx"] Jul 29 16:52:36.999360 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:36.999327 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa45b4d_6f7c_4f8b_bf00_e5de0543df45.slice/crio-7130238553a25c3b37662c09c95e19b4b1188c5e680d72a842c06810b4da1479 WatchSource:0}: Error finding container 7130238553a25c3b37662c09c95e19b4b1188c5e680d72a842c06810b4da1479: Status 404 returned error can't find the container with id 7130238553a25c3b37662c09c95e19b4b1188c5e680d72a842c06810b4da1479 Jul 29 16:52:37.016750 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.016732 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9w5dd"] Jul 29 16:52:37.019485 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:37.019458 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f3887b_6db3_4b15_9874_8403eed85250.slice/crio-46ff0e26df27730eee597355d9dce219a48912b7e4a2412df96c7e928c8fc47d WatchSource:0}: Error finding container 46ff0e26df27730eee597355d9dce219a48912b7e4a2412df96c7e928c8fc47d: Status 404 returned error can't find the container with id 46ff0e26df27730eee597355d9dce219a48912b7e4a2412df96c7e928c8fc47d Jul 29 16:52:37.045076 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.045043 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-mx49x" Jul 29 16:52:37.220192 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.220160 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-6lgdg"] Jul 29 16:52:37.233236 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.233208 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-6lgdg" Jul 29 16:52:37.233398 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.233380 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-6lgdg"] Jul 29 16:52:37.235597 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.235566 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cjbp4\"" Jul 29 16:52:37.235597 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.235586 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 16:52:37.235782 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.235566 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 16:52:37.319803 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.319770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7jhn\" (UniqueName: \"kubernetes.io/projected/baf8a83d-3182-43dc-b802-ab1fb3d08abd-kube-api-access-s7jhn\") pod \"downloads-7c97dc4555-6lgdg\" (UID: \"baf8a83d-3182-43dc-b802-ab1fb3d08abd\") " pod="openshift-console/downloads-7c97dc4555-6lgdg" Jul 29 16:52:37.421243 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.421162 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7jhn\" (UniqueName: \"kubernetes.io/projected/baf8a83d-3182-43dc-b802-ab1fb3d08abd-kube-api-access-s7jhn\") pod \"downloads-7c97dc4555-6lgdg\" (UID: \"baf8a83d-3182-43dc-b802-ab1fb3d08abd\") " pod="openshift-console/downloads-7c97dc4555-6lgdg" Jul 29 16:52:37.431774 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.431743 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7jhn\" (UniqueName: \"kubernetes.io/projected/baf8a83d-3182-43dc-b802-ab1fb3d08abd-kube-api-access-s7jhn\") pod \"downloads-7c97dc4555-6lgdg\" (UID: \"baf8a83d-3182-43dc-b802-ab1fb3d08abd\") " pod="openshift-console/downloads-7c97dc4555-6lgdg" Jul 29 16:52:37.544752 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.544719 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-6lgdg" Jul 29 16:52:37.690327 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.690240 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-6lgdg"] Jul 29 16:52:37.693425 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:37.693399 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf8a83d_3182_43dc_b802_ab1fb3d08abd.slice/crio-3f118c5c2a68ea2042cad7ea93e72187c48de0affecb25a4f7ac9d46180ce44b WatchSource:0}: Error finding container 3f118c5c2a68ea2042cad7ea93e72187c48de0affecb25a4f7ac9d46180ce44b: Status 404 returned error can't find the container with id 3f118c5c2a68ea2042cad7ea93e72187c48de0affecb25a4f7ac9d46180ce44b Jul 29 16:52:37.943305 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.943214 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" event={"ID":"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45","Type":"ContainerStarted","Data":"f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8"} Jul 29 16:52:37.943305 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.943280 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" event={"ID":"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45","Type":"ContainerStarted","Data":"7130238553a25c3b37662c09c95e19b4b1188c5e680d72a842c06810b4da1479"} Jul 29 16:52:37.943751 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.943332 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:52:37.944636 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.944601 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-6lgdg" event={"ID":"baf8a83d-3182-43dc-b802-ab1fb3d08abd","Type":"ContainerStarted","Data":"3f118c5c2a68ea2042cad7ea93e72187c48de0affecb25a4f7ac9d46180ce44b"} Jul 29 16:52:37.945788 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.945762 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9w5dd" event={"ID":"a7f3887b-6db3-4b15-9874-8403eed85250","Type":"ContainerStarted","Data":"46ff0e26df27730eee597355d9dce219a48912b7e4a2412df96c7e928c8fc47d"} Jul 29 16:52:37.970142 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:37.970095 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" podStartSLOduration=99.970081086 podStartE2EDuration="1m39.970081086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:37.969067356 +0000 UTC m=+100.932140248" watchObservedRunningTime="2026-07-29 16:52:37.970081086 +0000 UTC m=+100.933153985" Jul 29 16:52:39.958237 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:39.958198 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9w5dd" event={"ID":"a7f3887b-6db3-4b15-9874-8403eed85250","Type":"ContainerStarted","Data":"9a54736de817e581865c3baebf80a3af0c03c0ebaec8d623eac0bd65aa535dbe"} Jul 29 16:52:39.958720 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:39.958263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9w5dd" event={"ID":"a7f3887b-6db3-4b15-9874-8403eed85250","Type":"ContainerStarted","Data":"837d865b164413567dd404d6b0bfe4b2292d266ae8acd339675df4c7aaa6e22b"} Jul 29 16:52:39.958720 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:39.958367 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9w5dd" Jul 29 16:52:39.987689 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:39.987573 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9w5dd" podStartSLOduration=65.537393658 podStartE2EDuration="1m7.987552774s" totalImagesPullingTime="2.450159116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:39.98569502 +0000 UTC m=+102.948767924" watchObservedRunningTime="2026-07-29 16:52:39.987552774 +0000 UTC m=+102.950625674" Jul 29 16:52:40.335325 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.335237 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4hvrt"] Jul 29 16:52:40.353286 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.353263 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.360904 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.360639 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 16:52:40.360904 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.360672 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 16:52:40.361099 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.360913 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 16:52:40.362394 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.362372 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 16:52:40.362532 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.362506 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 16:52:40.363339 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.363315 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 16:52:40.365803 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.365787 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-flkgv\"" Jul 29 16:52:40.446062 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.446014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-textfile\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.446211 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.446066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb8c4589-57e0-40d3-a29c-0b79881cc97b-root\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.446211 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.446144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb8c4589-57e0-40d3-a29c-0b79881cc97b-sys\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.446211 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.446178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.446385 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.446216 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-tls\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.446385 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.446240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.446385 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.446280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-wtmp\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.446385 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.446305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czwtr\" (UniqueName: \"kubernetes.io/projected/cb8c4589-57e0-40d3-a29c-0b79881cc97b-kube-api-access-czwtr\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.446526 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.446384 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8c4589-57e0-40d3-a29c-0b79881cc97b-metrics-client-ca\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.547657 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547619 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb8c4589-57e0-40d3-a29c-0b79881cc97b-sys\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.547821 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.547821 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547708 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-tls\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.547821 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547735 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.547821 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547740 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb8c4589-57e0-40d3-a29c-0b79881cc97b-sys\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.547821 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-wtmp\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.547821 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547781 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czwtr\" (UniqueName: \"kubernetes.io/projected/cb8c4589-57e0-40d3-a29c-0b79881cc97b-kube-api-access-czwtr\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.548277 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547842 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8c4589-57e0-40d3-a29c-0b79881cc97b-metrics-client-ca\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.548277 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:40.547863 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 16:52:40.548277 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-textfile\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.548277 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547895 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-wtmp\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.548277 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.547917 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb8c4589-57e0-40d3-a29c-0b79881cc97b-root\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.548277 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:40.547972 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-tls podName:cb8c4589-57e0-40d3-a29c-0b79881cc97b nodeName:}" failed. No retries permitted until 2026-07-29 16:52:41.047950979 +0000 UTC m=+104.011023857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-tls") pod "node-exporter-4hvrt" (UID: "cb8c4589-57e0-40d3-a29c-0b79881cc97b") : secret "node-exporter-tls" not found Jul 29 16:52:40.548277 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.548150 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb8c4589-57e0-40d3-a29c-0b79881cc97b-root\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.548277 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.548221 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-textfile\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.548670 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.548429 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.548670 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.548553 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb8c4589-57e0-40d3-a29c-0b79881cc97b-metrics-client-ca\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.550396 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.550371 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.559355 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.559323 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czwtr\" (UniqueName: \"kubernetes.io/projected/cb8c4589-57e0-40d3-a29c-0b79881cc97b-kube-api-access-czwtr\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:40.811109 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:40.811039 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dng5h" Jul 29 16:52:41.051285 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.051252 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-tls\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:41.053895 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.053872 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb8c4589-57e0-40d3-a29c-0b79881cc97b-node-exporter-tls\") pod \"node-exporter-4hvrt\" (UID: \"cb8c4589-57e0-40d3-a29c-0b79881cc97b\") " pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:41.263677 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.263648 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4hvrt" Jul 29 16:52:41.275828 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:41.275794 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8c4589_57e0_40d3_a29c_0b79881cc97b.slice/crio-5d054244242a68a5a7d6e9214731c6e0c63832cc5f3c75849ccaf2eca8258edf WatchSource:0}: Error finding container 5d054244242a68a5a7d6e9214731c6e0c63832cc5f3c75849ccaf2eca8258edf: Status 404 returned error can't find the container with id 5d054244242a68a5a7d6e9214731c6e0c63832cc5f3c75849ccaf2eca8258edf Jul 29 16:52:41.396289 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.396251 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:52:41.399831 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.399808 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.402439 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.402409 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 16:52:41.402439 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.402415 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 16:52:41.402802 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.402780 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 16:52:41.402907 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.402857 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 16:52:41.402907 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.402868 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 16:52:41.403022 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.402911 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 16:52:41.403022 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.402779 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 16:52:41.403158 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.403085 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tq7jd\"" Jul 29 16:52:41.403207 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.403198 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 16:52:41.403294 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.403274 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 16:52:41.425484 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.425460 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:52:41.555161 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555087 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555161 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555125 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555161 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555157 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-out\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555363 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555184 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555363 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555363 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555259 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555363 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555363 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555363 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnr4q\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-kube-api-access-fnr4q\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555663 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555367 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555663 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555385 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555663 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555408 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-web-config\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.555663 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.555504 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-volume\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656309 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656281 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656482 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-web-config\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656482 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656388 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-volume\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656482 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656482 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656449 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656482 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656473 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-out\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656745 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656491 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656745 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656745 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656544 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656745 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656569 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656745 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656612 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656745 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656637 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnr4q\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-kube-api-access-fnr4q\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.656745 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.656665 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.657231 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:41.657204 2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 29 16:52:41.657343 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:41.657274 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-main-tls podName:0fa3bcdf-236d-4e31-a5cf-28bd8288fd37 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:42.157255256 +0000 UTC m=+105.120328133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37") : secret "alertmanager-main-tls" not found Jul 29 16:52:41.659201 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.658295 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.659201 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.658896 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.659201 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.658913 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.660119 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.660078 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-out\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.662206 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.661961 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.662206 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.662155 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-web-config\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.662551 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.662526 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.662812 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.662784 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.663300 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.663260 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-volume\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.664193 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.664169 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.664699 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.664676 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.666855 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.666834 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnr4q\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-kube-api-access-fnr4q\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:41.967607 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:41.967569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hvrt" event={"ID":"cb8c4589-57e0-40d3-a29c-0b79881cc97b","Type":"ContainerStarted","Data":"5d054244242a68a5a7d6e9214731c6e0c63832cc5f3c75849ccaf2eca8258edf"} Jul 29 16:52:42.160808 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.160780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:42.163503 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.163471 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:42.299161 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.299129 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-788dc86f6-zhktt"] Jul 29 16:52:42.302547 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.302519 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.304797 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.304770 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 16:52:42.304797 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.304775 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1aad9smbvvr3v\"" Jul 29 16:52:42.304978 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.304829 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 16:52:42.304978 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.304884 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 16:52:42.305181 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.305111 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 16:52:42.305247 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.305214 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 16:52:42.305324 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.305309 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zkmhs\"" Jul 29 16:52:42.311566 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.311545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:52:42.314502 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.314483 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-788dc86f6-zhktt"] Jul 29 16:52:42.463072 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.462859 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:52:42.464623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.464595 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12b9720e-6ae6-4806-8a7b-eb6a60356406-metrics-client-ca\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.464732 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.464678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-tls\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.464732 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.464712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.464846 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.464739 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.464846 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.464775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.464846 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.464799 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-grpc-tls\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.464999 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.464846 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5tlr\" (UniqueName: \"kubernetes.io/projected/12b9720e-6ae6-4806-8a7b-eb6a60356406-kube-api-access-v5tlr\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.464999 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.464877 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.465937 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:42.465911 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa3bcdf_236d_4e31_a5cf_28bd8288fd37.slice/crio-58ece61e6876d0a372156b3faca225816d1bd0976efe67deb00512674c280e95 WatchSource:0}: Error finding container 58ece61e6876d0a372156b3faca225816d1bd0976efe67deb00512674c280e95: Status 404 returned error can't find the container with id 58ece61e6876d0a372156b3faca225816d1bd0976efe67deb00512674c280e95 Jul 29 16:52:42.566270 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.566192 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-tls\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.566270 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.566234 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.566270 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.566254 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.566516 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.566288 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.566516 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.566314 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-grpc-tls\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.566625 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.566522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5tlr\" (UniqueName: \"kubernetes.io/projected/12b9720e-6ae6-4806-8a7b-eb6a60356406-kube-api-access-v5tlr\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.566625 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.566565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.566731 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.566627 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12b9720e-6ae6-4806-8a7b-eb6a60356406-metrics-client-ca\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.567456 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.567427 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12b9720e-6ae6-4806-8a7b-eb6a60356406-metrics-client-ca\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.569295 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.569270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.569397 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.569384 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-grpc-tls\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.569717 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.569692 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.569829 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.569796 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.569895 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.569825 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.570173 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.570153 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/12b9720e-6ae6-4806-8a7b-eb6a60356406-secret-thanos-querier-tls\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.576129 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.575076 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5tlr\" (UniqueName: \"kubernetes.io/projected/12b9720e-6ae6-4806-8a7b-eb6a60356406-kube-api-access-v5tlr\") pod \"thanos-querier-788dc86f6-zhktt\" (UID: \"12b9720e-6ae6-4806-8a7b-eb6a60356406\") " pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.646614 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.646588 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:42.795970 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.795934 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-788dc86f6-zhktt"] Jul 29 16:52:42.799823 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:42.799793 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b9720e_6ae6_4806_8a7b_eb6a60356406.slice/crio-a8fbf55bf326b1cab3cd2b544bb2c3216b69240a9d70408f6efc3529df824bc1 WatchSource:0}: Error finding container a8fbf55bf326b1cab3cd2b544bb2c3216b69240a9d70408f6efc3529df824bc1: Status 404 returned error can't find the container with id a8fbf55bf326b1cab3cd2b544bb2c3216b69240a9d70408f6efc3529df824bc1 Jul 29 16:52:42.973218 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.973180 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" event={"ID":"12b9720e-6ae6-4806-8a7b-eb6a60356406","Type":"ContainerStarted","Data":"a8fbf55bf326b1cab3cd2b544bb2c3216b69240a9d70408f6efc3529df824bc1"} Jul 29 16:52:42.975011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.974985 2556 generic.go:356] "Generic (PLEG): container finished" podID="cb8c4589-57e0-40d3-a29c-0b79881cc97b" containerID="2fd119eb5e4e94d1c1f4b6ba51d294758cf1bbbe944fd22d09470cc432d5b454" exitCode=0 Jul 29 16:52:42.975156 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.975069 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hvrt" event={"ID":"cb8c4589-57e0-40d3-a29c-0b79881cc97b","Type":"ContainerDied","Data":"2fd119eb5e4e94d1c1f4b6ba51d294758cf1bbbe944fd22d09470cc432d5b454"} Jul 29 16:52:42.976420 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:42.976395 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerStarted","Data":"58ece61e6876d0a372156b3faca225816d1bd0976efe67deb00512674c280e95"} Jul 29 16:52:43.347888 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:43.347812 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f954dbcf-hc7tx"] Jul 29 16:52:43.984029 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:43.983991 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hvrt" event={"ID":"cb8c4589-57e0-40d3-a29c-0b79881cc97b","Type":"ContainerStarted","Data":"4e993bda86cfe956589c009beeef44c6efefb8d14c57886b0228b189927a67c2"} Jul 29 16:52:43.984209 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:43.984093 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hvrt" event={"ID":"cb8c4589-57e0-40d3-a29c-0b79881cc97b","Type":"ContainerStarted","Data":"7ec8b30ce190a6562fa797f63a62b444732352e3dc0b2459a00c405118a3bd38"} Jul 29 16:52:43.986512 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:43.986487 2556 generic.go:356] "Generic (PLEG): container finished" podID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerID="159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab" exitCode=0 Jul 29 16:52:43.986628 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:43.986524 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerDied","Data":"159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab"} Jul 29 16:52:44.013988 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:44.013939 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4hvrt" podStartSLOduration=3.088391685 podStartE2EDuration="4.013924825s" totalImagesPullingTime="852.503818ms" totalInitContainerRuntime="73.029322ms" isStatefulPod=true podCreationTimestamp="2026-07-29 16:52:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:44.01235357 +0000 UTC m=+106.975426468" watchObservedRunningTime="2026-07-29 16:52:44.013924825 +0000 UTC m=+106.976997721" Jul 29 16:52:44.993083 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:44.992980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" event={"ID":"12b9720e-6ae6-4806-8a7b-eb6a60356406","Type":"ContainerStarted","Data":"009b6470a42608b3f5b6d817495ee0bb89413f58d34f1ede366e600ba51139a9"} Jul 29 16:52:44.993516 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:44.993082 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" event={"ID":"12b9720e-6ae6-4806-8a7b-eb6a60356406","Type":"ContainerStarted","Data":"6e3c3625e3ef081c09631fba890cf90e17c36e6a295dc849f2d0a3211bef46ff"} Jul 29 16:52:44.993516 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:44.993127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" event={"ID":"12b9720e-6ae6-4806-8a7b-eb6a60356406","Type":"ContainerStarted","Data":"19c9047a2f39b60bb8d72f162752ebc0a3b013b3372d640532a314788992dfc9"} Jul 29 16:52:45.052456 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.052424 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k"] Jul 29 16:52:45.054805 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.054780 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:45.057778 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.057744 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2764p\"" Jul 29 16:52:45.058963 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.058943 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 16:52:45.065164 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.065094 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k"] Jul 29 16:52:45.193005 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.192972 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30394f84-d783-4422-b775-ed627d50074b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-hqd4k\" (UID: \"30394f84-d783-4422-b775-ed627d50074b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:45.193202 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.193080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gxjl\" (UniqueName: \"kubernetes.io/projected/30394f84-d783-4422-b775-ed627d50074b-kube-api-access-7gxjl\") pod \"monitoring-plugin-68b7fc9574-hqd4k\" (UID: \"30394f84-d783-4422-b775-ed627d50074b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:45.294365 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.294284 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30394f84-d783-4422-b775-ed627d50074b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-hqd4k\" (UID: \"30394f84-d783-4422-b775-ed627d50074b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:45.294508 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.294362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gxjl\" (UniqueName: \"kubernetes.io/projected/30394f84-d783-4422-b775-ed627d50074b-kube-api-access-7gxjl\") pod \"monitoring-plugin-68b7fc9574-hqd4k\" (UID: \"30394f84-d783-4422-b775-ed627d50074b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:45.294508 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:45.294422 2556 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 29 16:52:45.294508 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:52:45.294486 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30394f84-d783-4422-b775-ed627d50074b-monitoring-plugin-cert podName:30394f84-d783-4422-b775-ed627d50074b nodeName:}" failed. No retries permitted until 2026-07-29 16:52:45.794468606 +0000 UTC m=+108.757541491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/30394f84-d783-4422-b775-ed627d50074b-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-hqd4k" (UID: "30394f84-d783-4422-b775-ed627d50074b") : secret "monitoring-plugin-cert" not found Jul 29 16:52:45.304242 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.304190 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gxjl\" (UniqueName: \"kubernetes.io/projected/30394f84-d783-4422-b775-ed627d50074b-kube-api-access-7gxjl\") pod \"monitoring-plugin-68b7fc9574-hqd4k\" (UID: \"30394f84-d783-4422-b775-ed627d50074b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:45.609352 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.609271 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz"] Jul 29 16:52:45.611901 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.611879 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.614424 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.614402 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 16:52:45.615908 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.614802 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 16:52:45.615908 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.614983 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 16:52:45.615908 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.615193 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hsrff\"" Jul 29 16:52:45.615908 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.615404 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 16:52:45.615908 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.615579 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 16:52:45.620950 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.620928 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 16:52:45.631555 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.631492 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz"] Jul 29 16:52:45.698233 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.698202 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbvrh\" (UniqueName: \"kubernetes.io/projected/42e7c8d5-48e0-4e06-973f-1f2b714e540f-kube-api-access-pbvrh\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.698407 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.698256 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e7c8d5-48e0-4e06-973f-1f2b714e540f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.698407 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.698293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e7c8d5-48e0-4e06-973f-1f2b714e540f-serving-certs-ca-bundle\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.698407 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.698315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-federate-client-tls\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.698407 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.698378 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.698572 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.698432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-telemeter-client-tls\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.698572 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.698466 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42e7c8d5-48e0-4e06-973f-1f2b714e540f-metrics-client-ca\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.698572 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.698501 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-secret-telemeter-client\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.799254 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.799220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbvrh\" (UniqueName: \"kubernetes.io/projected/42e7c8d5-48e0-4e06-973f-1f2b714e540f-kube-api-access-pbvrh\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.799416 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.799275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e7c8d5-48e0-4e06-973f-1f2b714e540f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.799416 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.799324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e7c8d5-48e0-4e06-973f-1f2b714e540f-serving-certs-ca-bundle\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.799416 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.799351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-federate-client-tls\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.799416 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.799400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.799624 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.799434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-telemeter-client-tls\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.799624 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.799467 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42e7c8d5-48e0-4e06-973f-1f2b714e540f-metrics-client-ca\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.799624 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.799499 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30394f84-d783-4422-b775-ed627d50074b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-hqd4k\" (UID: \"30394f84-d783-4422-b775-ed627d50074b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:45.799624 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.799528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-secret-telemeter-client\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.800495 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.800466 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/42e7c8d5-48e0-4e06-973f-1f2b714e540f-metrics-client-ca\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.800625 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.800573 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e7c8d5-48e0-4e06-973f-1f2b714e540f-serving-certs-ca-bundle\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.800786 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.800762 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42e7c8d5-48e0-4e06-973f-1f2b714e540f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.802782 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.802714 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-telemeter-client-tls\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.803690 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.803346 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.803690 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.803602 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-secret-telemeter-client\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.803822 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.803754 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/30394f84-d783-4422-b775-ed627d50074b-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-hqd4k\" (UID: \"30394f84-d783-4422-b775-ed627d50074b\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:45.803822 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.803792 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/42e7c8d5-48e0-4e06-973f-1f2b714e540f-federate-client-tls\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.818233 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.818191 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbvrh\" (UniqueName: \"kubernetes.io/projected/42e7c8d5-48e0-4e06-973f-1f2b714e540f-kube-api-access-pbvrh\") pod \"telemeter-client-6ff847dd7f-7cmkz\" (UID: \"42e7c8d5-48e0-4e06-973f-1f2b714e540f\") " pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.925474 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.925400 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" Jul 29 16:52:45.966114 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:45.966084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:46.277987 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:46.277907 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz"] Jul 29 16:52:46.283097 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:46.282737 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e7c8d5_48e0_4e06_973f_1f2b714e540f.slice/crio-8f016ead7f6da4ce2150396d39bb1ea11bb025ad4c08a0d8730d392d4ee49923 WatchSource:0}: Error finding container 8f016ead7f6da4ce2150396d39bb1ea11bb025ad4c08a0d8730d392d4ee49923: Status 404 returned error can't find the container with id 8f016ead7f6da4ce2150396d39bb1ea11bb025ad4c08a0d8730d392d4ee49923 Jul 29 16:52:46.296369 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:46.295249 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k"] Jul 29 16:52:46.304518 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:46.304491 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30394f84_d783_4422_b775_ed627d50074b.slice/crio-55c4dc9a6858c2c84f0045465c896d2c4ff8adc6910404635db29232a5b8a690 WatchSource:0}: Error finding container 55c4dc9a6858c2c84f0045465c896d2c4ff8adc6910404635db29232a5b8a690: Status 404 returned error can't find the container with id 55c4dc9a6858c2c84f0045465c896d2c4ff8adc6910404635db29232a5b8a690 Jul 29 16:52:47.007460 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.007424 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerStarted","Data":"cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115"} Jul 29 16:52:47.007649 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.007516 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerStarted","Data":"bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922"} Jul 29 16:52:47.007649 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.007562 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerStarted","Data":"8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9"} Jul 29 16:52:47.007649 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.007601 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerStarted","Data":"cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f"} Jul 29 16:52:47.007649 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.007641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerStarted","Data":"2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548"} Jul 29 16:52:47.007870 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.007678 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerStarted","Data":"652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287"} Jul 29 16:52:47.009232 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.009207 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" event={"ID":"42e7c8d5-48e0-4e06-973f-1f2b714e540f","Type":"ContainerStarted","Data":"8f016ead7f6da4ce2150396d39bb1ea11bb025ad4c08a0d8730d392d4ee49923"} Jul 29 16:52:47.010710 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.010665 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" event={"ID":"30394f84-d783-4422-b775-ed627d50074b","Type":"ContainerStarted","Data":"55c4dc9a6858c2c84f0045465c896d2c4ff8adc6910404635db29232a5b8a690"} Jul 29 16:52:47.014317 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.014292 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" event={"ID":"12b9720e-6ae6-4806-8a7b-eb6a60356406","Type":"ContainerStarted","Data":"50843a6b0dd8fae07ba49a314dc05e956c524103473d2ac26f6ea1f50931ea86"} Jul 29 16:52:47.014413 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.014357 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" event={"ID":"12b9720e-6ae6-4806-8a7b-eb6a60356406","Type":"ContainerStarted","Data":"b763862e1f68d7c483612b678020e2d0e5c811532a396d28bfaec60f85500595"} Jul 29 16:52:47.014413 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.014406 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:47.014604 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.014444 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" event={"ID":"12b9720e-6ae6-4806-8a7b-eb6a60356406","Type":"ContainerStarted","Data":"9329f9b32bd23b54fe026f25b991357f92360bf8e8b7efb26880fc8849f5bbc4"} Jul 29 16:52:47.052572 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:47.052498 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.680759444 podStartE2EDuration="6.052484268s" totalImagesPullingTime="3.34614355s" totalInitContainerRuntime="25.581274ms" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:47.050750328 +0000 UTC m=+110.013823251" watchObservedRunningTime="2026-07-29 16:52:47.052484268 +0000 UTC m=+110.015557166" Jul 29 16:52:48.021682 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:48.021473 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" event={"ID":"30394f84-d783-4422-b775-ed627d50074b","Type":"ContainerStarted","Data":"e37a5a5701d2131742855eebce962553130ab0afcf9b6e978b4892fc5a0810c5"} Jul 29 16:52:48.022698 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:48.022644 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:48.028085 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:48.028063 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" Jul 29 16:52:48.042397 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:48.042352 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" podStartSLOduration=2.922110927 podStartE2EDuration="6.042332318s" totalImagesPullingTime="3.120221391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:47.183601152 +0000 UTC m=+110.146674052" watchObservedRunningTime="2026-07-29 16:52:48.042332318 +0000 UTC m=+111.005405218" Jul 29 16:52:48.042862 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:48.042827 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-hqd4k" podStartSLOduration=1.6220238249999999 podStartE2EDuration="3.042819815s" totalImagesPullingTime="1.42079599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:48.041040069 +0000 UTC m=+111.004112980" watchObservedRunningTime="2026-07-29 16:52:48.042819815 +0000 UTC m=+111.005892718" Jul 29 16:52:49.965353 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:49.965316 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9w5dd" Jul 29 16:52:50.139065 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.139021 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65dcf4566b-56whx"] Jul 29 16:52:50.142748 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.142727 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.146375 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.146309 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 16:52:50.146446 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.146408 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 16:52:50.146831 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.146812 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 16:52:50.146934 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.146912 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j27tm\"" Jul 29 16:52:50.147002 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.146930 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 16:52:50.147002 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.146978 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 16:52:50.152167 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.152150 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 16:52:50.156590 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.156563 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65dcf4566b-56whx"] Jul 29 16:52:50.242436 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.242402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-oauth-serving-cert\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.242577 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.242470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-trusted-ca-bundle\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.242577 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.242529 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-serving-cert\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.242577 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.242554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-service-ca\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.242705 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.242579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szbw6\" (UniqueName: \"kubernetes.io/projected/002ed67c-491c-4441-af2e-a44f6152bf50-kube-api-access-szbw6\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.242705 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.242642 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-oauth-config\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.242705 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.242668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-console-config\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.343308 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.343276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-trusted-ca-bundle\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.343484 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.343334 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-serving-cert\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.343484 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.343365 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-service-ca\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.343484 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.343391 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szbw6\" (UniqueName: \"kubernetes.io/projected/002ed67c-491c-4441-af2e-a44f6152bf50-kube-api-access-szbw6\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.343484 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.343462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-oauth-config\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.343690 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.343487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-console-config\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.343690 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.343530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-oauth-serving-cert\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.344378 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.344235 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-trusted-ca-bundle\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.344378 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.344311 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-service-ca\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.344378 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.344335 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-oauth-serving-cert\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.344909 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.344885 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-console-config\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.346294 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.346269 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-serving-cert\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.346388 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.346305 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-oauth-config\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.351984 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.351960 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szbw6\" (UniqueName: \"kubernetes.io/projected/002ed67c-491c-4441-af2e-a44f6152bf50-kube-api-access-szbw6\") pod \"console-65dcf4566b-56whx\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:50.454411 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:50.454370 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:52:53.028269 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:53.028242 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-788dc86f6-zhktt" Jul 29 16:52:53.356071 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:53.355981 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:52:55.961595 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:55.961532 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65dcf4566b-56whx"] Jul 29 16:52:55.964227 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:52:55.964199 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002ed67c_491c_4441_af2e_a44f6152bf50.slice/crio-a342982d2885902533b56af22b5f917dfe3f612863eba74ef154fe7c3af87ca0 WatchSource:0}: Error finding container a342982d2885902533b56af22b5f917dfe3f612863eba74ef154fe7c3af87ca0: Status 404 returned error can't find the container with id a342982d2885902533b56af22b5f917dfe3f612863eba74ef154fe7c3af87ca0 Jul 29 16:52:56.057721 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:56.057673 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-6lgdg" event={"ID":"baf8a83d-3182-43dc-b802-ab1fb3d08abd","Type":"ContainerStarted","Data":"6f0372b08ae0600477b9d90cbfe1d70f7377f2c3967a3236d22138e01e18d650"} Jul 29 16:52:56.058010 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:56.057990 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-6lgdg" Jul 29 16:52:56.059383 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:56.059360 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dcf4566b-56whx" event={"ID":"002ed67c-491c-4441-af2e-a44f6152bf50","Type":"ContainerStarted","Data":"a342982d2885902533b56af22b5f917dfe3f612863eba74ef154fe7c3af87ca0"} Jul 29 16:52:56.059610 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:56.059482 2556 patch_prober.go:28] interesting pod/downloads-7c97dc4555-6lgdg container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused" start-of-body= Jul 29 16:52:56.059610 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:56.059540 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-6lgdg" podUID="baf8a83d-3182-43dc-b802-ab1fb3d08abd" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused" Jul 29 16:52:56.061303 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:56.061280 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" event={"ID":"42e7c8d5-48e0-4e06-973f-1f2b714e540f","Type":"ContainerStarted","Data":"9e48f429536a5b372c3ee1da52bfdb6f7d0eb50961888507e50d545ef8739887"} Jul 29 16:52:56.075893 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:56.075819 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-6lgdg" podStartSLOduration=0.873885892 podStartE2EDuration="19.075801866s" totalImagesPullingTime="18.201915974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:56.075726513 +0000 UTC m=+119.038799415" watchObservedRunningTime="2026-07-29 16:52:56.075801866 +0000 UTC m=+119.038874768" Jul 29 16:52:57.071079 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:57.071024 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" event={"ID":"42e7c8d5-48e0-4e06-973f-1f2b714e540f","Type":"ContainerStarted","Data":"f22537d444b16e4640f8dfbf21fbe107f2a131ae76af3d9712d4086cb98d67d2"} Jul 29 16:52:57.071537 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:57.071148 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" event={"ID":"42e7c8d5-48e0-4e06-973f-1f2b714e540f","Type":"ContainerStarted","Data":"c9882f3c4e9836c41d103fb4bf85e647f93d432f7e4b8a5d6dbf9453add590d5"} Jul 29 16:52:57.087198 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:57.087171 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-6lgdg" Jul 29 16:52:57.116772 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:57.116437 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6ff847dd7f-7cmkz" podStartSLOduration=2.570233989 podStartE2EDuration="12.116418512s" totalImagesPullingTime="9.546184523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:57.111774335 +0000 UTC m=+120.074847234" watchObservedRunningTime="2026-07-29 16:52:57.116418512 +0000 UTC m=+120.079491413" Jul 29 16:52:59.948407 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:52:59.948374 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65dcf4566b-56whx"] Jul 29 16:53:01.092470 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:01.092430 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dcf4566b-56whx" event={"ID":"002ed67c-491c-4441-af2e-a44f6152bf50","Type":"ContainerStarted","Data":"ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d"} Jul 29 16:53:01.111320 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:01.111266 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65dcf4566b-56whx" podStartSLOduration=6.8976430220000005 podStartE2EDuration="11.111251156s" totalImagesPullingTime="4.213608134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:53:01.109355546 +0000 UTC m=+124.072428446" watchObservedRunningTime="2026-07-29 16:53:01.111251156 +0000 UTC m=+124.074324055" Jul 29 16:53:07.300072 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:07.300013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:53:07.302260 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:07.302236 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1da775fc-ac1d-4a60-89cc-c18daa86454c-metrics-certs\") pod \"network-metrics-daemon-s29ts\" (UID: \"1da775fc-ac1d-4a60-89cc-c18daa86454c\") " pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:53:07.539884 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:07.539860 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vc7v9\"" Jul 29 16:53:07.547868 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:07.547851 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s29ts" Jul 29 16:53:07.772899 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:07.772871 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s29ts"] Jul 29 16:53:07.775745 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:53:07.775718 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da775fc_ac1d_4a60_89cc_c18daa86454c.slice/crio-06c5149e0ecba41d08213bb615ac526c64de4c5dec31c8ab157012bee5064f93 WatchSource:0}: Error finding container 06c5149e0ecba41d08213bb615ac526c64de4c5dec31c8ab157012bee5064f93: Status 404 returned error can't find the container with id 06c5149e0ecba41d08213bb615ac526c64de4c5dec31c8ab157012bee5064f93 Jul 29 16:53:08.120733 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.120701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s29ts" event={"ID":"1da775fc-ac1d-4a60-89cc-c18daa86454c","Type":"ContainerStarted","Data":"06c5149e0ecba41d08213bb615ac526c64de4c5dec31c8ab157012bee5064f93"} Jul 29 16:53:08.375169 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.375071 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" podUID="4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" containerName="registry" containerID="cri-o://f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8" gracePeriod=30 Jul 29 16:53:08.636713 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.636658 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:53:08.715659 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.715630 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-certificates\") pod \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " Jul 29 16:53:08.715659 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.715664 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-ca-trust-extracted\") pod \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " Jul 29 16:53:08.715917 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.715683 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-image-registry-private-configuration\") pod \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " Jul 29 16:53:08.715917 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.715713 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") pod \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " Jul 29 16:53:08.715917 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.715758 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-installation-pull-secrets\") pod \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " Jul 29 16:53:08.715917 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.715782 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhzjm\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-kube-api-access-jhzjm\") pod \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " Jul 29 16:53:08.716159 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.715991 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-trusted-ca\") pod \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " Jul 29 16:53:08.716159 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.716031 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-bound-sa-token\") pod \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\" (UID: \"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45\") " Jul 29 16:53:08.716455 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.716423 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:08.716564 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.716546 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-trusted-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:08.716809 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.716782 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:08.718310 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.718277 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:53:08.718419 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.718357 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:53:08.718624 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.718590 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-kube-api-access-jhzjm" (OuterVolumeSpecName: "kube-api-access-jhzjm") pod "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45"). InnerVolumeSpecName "kube-api-access-jhzjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:53:08.718807 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.718788 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:53:08.718882 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.718863 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:53:08.724274 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.724251 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" (UID: "4fa45b4d-6f7c-4f8b-bf00-e5de0543df45"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:53:08.817223 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.817197 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:08.817223 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.817218 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-installation-pull-secrets\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:08.817223 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.817227 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhzjm\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-kube-api-access-jhzjm\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:08.817388 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.817236 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-bound-sa-token\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:08.817388 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.817244 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-registry-certificates\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:08.817388 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.817252 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-ca-trust-extracted\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:08.817388 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:08.817263 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45-image-registry-private-configuration\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:09.125733 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.125696 2556 generic.go:356] "Generic (PLEG): container finished" podID="4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" containerID="f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8" exitCode=0 Jul 29 16:53:09.125919 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.125745 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" Jul 29 16:53:09.125919 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.125788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" event={"ID":"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45","Type":"ContainerDied","Data":"f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8"} Jul 29 16:53:09.125919 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.125843 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78f954dbcf-hc7tx" event={"ID":"4fa45b4d-6f7c-4f8b-bf00-e5de0543df45","Type":"ContainerDied","Data":"7130238553a25c3b37662c09c95e19b4b1188c5e680d72a842c06810b4da1479"} Jul 29 16:53:09.125919 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.125865 2556 scope.go:117] "RemoveContainer" containerID="f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8" Jul 29 16:53:09.146529 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.146509 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78f954dbcf-hc7tx"] Jul 29 16:53:09.148387 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.148370 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78f954dbcf-hc7tx"] Jul 29 16:53:09.433633 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.433612 2556 scope.go:117] "RemoveContainer" containerID="f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8" Jul 29 16:53:09.433966 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:53:09.433941 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8\": container with ID starting with f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8 not found: ID does not exist" containerID="f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8" Jul 29 16:53:09.434010 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.433967 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8"} err="failed to get container status \"f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8\": rpc error: code = NotFound desc = could not find container \"f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8\": container with ID starting with f2936fdbdb2dca044101802909e0a7a1e4ddfdda4c4f546454c1a7c53908dac8 not found: ID does not exist" Jul 29 16:53:09.535366 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:09.535330 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" path="/var/lib/kubelet/pods/4fa45b4d-6f7c-4f8b-bf00-e5de0543df45/volumes" Jul 29 16:53:10.061912 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:10.061891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9hcc_d7db8c4c-f98f-4446-be03-ccce318d5563/serve-healthcheck-canary/0.log" Jul 29 16:53:10.131234 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:10.131201 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s29ts" event={"ID":"1da775fc-ac1d-4a60-89cc-c18daa86454c","Type":"ContainerStarted","Data":"976b5015dc1124cbab567e34ac4c2025159e416eb2c33b44d13de735fc2d22d1"} Jul 29 16:53:10.131357 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:10.131292 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s29ts" event={"ID":"1da775fc-ac1d-4a60-89cc-c18daa86454c","Type":"ContainerStarted","Data":"8c3256aca6c96158718f1327546ba6e09ef323edd4c7f01f7f4e12a2e3f98105"} Jul 29 16:53:10.155500 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:10.155451 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s29ts" podStartSLOduration=130.117511555 podStartE2EDuration="2m12.155436883s" totalImagesPullingTime="2.037925328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:53:10.154927146 +0000 UTC m=+133.118000047" watchObservedRunningTime="2026-07-29 16:53:10.155436883 +0000 UTC m=+133.118509779" Jul 29 16:53:10.454962 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:10.454890 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:53:26.114021 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.113983 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65dcf4566b-56whx" podUID="002ed67c-491c-4441-af2e-a44f6152bf50" containerName="console" containerID="cri-o://ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d" gracePeriod=15 Jul 29 16:53:26.386978 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.386917 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:53:26.565021 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.564991 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-serving-cert\") pod \"002ed67c-491c-4441-af2e-a44f6152bf50\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " Jul 29 16:53:26.565205 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565038 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-service-ca\") pod \"002ed67c-491c-4441-af2e-a44f6152bf50\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " Jul 29 16:53:26.565205 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565086 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-oauth-config\") pod \"002ed67c-491c-4441-af2e-a44f6152bf50\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " Jul 29 16:53:26.565205 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565119 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-trusted-ca-bundle\") pod \"002ed67c-491c-4441-af2e-a44f6152bf50\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " Jul 29 16:53:26.565205 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565161 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-oauth-serving-cert\") pod \"002ed67c-491c-4441-af2e-a44f6152bf50\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " Jul 29 16:53:26.565205 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565197 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-console-config\") pod \"002ed67c-491c-4441-af2e-a44f6152bf50\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " Jul 29 16:53:26.565455 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565257 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szbw6\" (UniqueName: \"kubernetes.io/projected/002ed67c-491c-4441-af2e-a44f6152bf50-kube-api-access-szbw6\") pod \"002ed67c-491c-4441-af2e-a44f6152bf50\" (UID: \"002ed67c-491c-4441-af2e-a44f6152bf50\") " Jul 29 16:53:26.565513 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565464 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-service-ca" (OuterVolumeSpecName: "service-ca") pod "002ed67c-491c-4441-af2e-a44f6152bf50" (UID: "002ed67c-491c-4441-af2e-a44f6152bf50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:26.565593 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565566 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "002ed67c-491c-4441-af2e-a44f6152bf50" (UID: "002ed67c-491c-4441-af2e-a44f6152bf50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:26.565656 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565563 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "002ed67c-491c-4441-af2e-a44f6152bf50" (UID: "002ed67c-491c-4441-af2e-a44f6152bf50"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:26.565656 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.565605 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-console-config" (OuterVolumeSpecName: "console-config") pod "002ed67c-491c-4441-af2e-a44f6152bf50" (UID: "002ed67c-491c-4441-af2e-a44f6152bf50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:26.567273 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.567250 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "002ed67c-491c-4441-af2e-a44f6152bf50" (UID: "002ed67c-491c-4441-af2e-a44f6152bf50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:53:26.567395 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.567376 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "002ed67c-491c-4441-af2e-a44f6152bf50" (UID: "002ed67c-491c-4441-af2e-a44f6152bf50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:53:26.567435 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.567400 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002ed67c-491c-4441-af2e-a44f6152bf50-kube-api-access-szbw6" (OuterVolumeSpecName: "kube-api-access-szbw6") pod "002ed67c-491c-4441-af2e-a44f6152bf50" (UID: "002ed67c-491c-4441-af2e-a44f6152bf50"). InnerVolumeSpecName "kube-api-access-szbw6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:53:26.666752 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.666697 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szbw6\" (UniqueName: \"kubernetes.io/projected/002ed67c-491c-4441-af2e-a44f6152bf50-kube-api-access-szbw6\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:26.666752 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.666718 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-serving-cert\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:26.666752 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.666727 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:26.666752 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.666736 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/002ed67c-491c-4441-af2e-a44f6152bf50-console-oauth-config\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:26.666752 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.666744 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-trusted-ca-bundle\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:26.666752 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.666752 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-oauth-serving-cert\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:26.667004 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:26.666762 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/002ed67c-491c-4441-af2e-a44f6152bf50-console-config\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:53:27.202953 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.202916 2556 generic.go:356] "Generic (PLEG): container finished" podID="002ed67c-491c-4441-af2e-a44f6152bf50" containerID="ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d" exitCode=0 Jul 29 16:53:27.203416 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.202967 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dcf4566b-56whx" event={"ID":"002ed67c-491c-4441-af2e-a44f6152bf50","Type":"ContainerDied","Data":"ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d"} Jul 29 16:53:27.203416 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.202970 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65dcf4566b-56whx" Jul 29 16:53:27.203416 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.203028 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65dcf4566b-56whx" event={"ID":"002ed67c-491c-4441-af2e-a44f6152bf50","Type":"ContainerDied","Data":"a342982d2885902533b56af22b5f917dfe3f612863eba74ef154fe7c3af87ca0"} Jul 29 16:53:27.203416 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.203067 2556 scope.go:117] "RemoveContainer" containerID="ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d" Jul 29 16:53:27.212032 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.212017 2556 scope.go:117] "RemoveContainer" containerID="ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d" Jul 29 16:53:27.212377 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:53:27.212358 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d\": container with ID starting with ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d not found: ID does not exist" containerID="ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d" Jul 29 16:53:27.212438 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.212387 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d"} err="failed to get container status \"ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d\": rpc error: code = NotFound desc = could not find container \"ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d\": container with ID starting with ba2163acdae293258c0bd5f45d3c3fa0360037b795d80699df935ecd9a5b723d not found: ID does not exist" Jul 29 16:53:27.229283 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.229261 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65dcf4566b-56whx"] Jul 29 16:53:27.239585 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.239561 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65dcf4566b-56whx"] Jul 29 16:53:27.534868 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:53:27.534835 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="002ed67c-491c-4441-af2e-a44f6152bf50" path="/var/lib/kubelet/pods/002ed67c-491c-4441-af2e-a44f6152bf50/volumes" Jul 29 16:54:01.028350 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.028318 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:54:01.028784 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.028579 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="alertmanager" containerID="cri-o://652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287" gracePeriod=120 Jul 29 16:54:01.028784 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.028659 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy-metric" containerID="cri-o://bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922" gracePeriod=120 Jul 29 16:54:01.028784 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.028692 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="config-reloader" containerID="cri-o://2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548" gracePeriod=120 Jul 29 16:54:01.028784 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.028716 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy" containerID="cri-o://8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9" gracePeriod=120 Jul 29 16:54:01.028784 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.028741 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="prom-label-proxy" containerID="cri-o://cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115" gracePeriod=120 Jul 29 16:54:01.028784 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.028663 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy-web" containerID="cri-o://cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f" gracePeriod=120 Jul 29 16:54:01.086497 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.086443 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bf68c8bfd-6whdz"] Jul 29 16:54:01.086819 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.086804 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="002ed67c-491c-4441-af2e-a44f6152bf50" containerName="console" Jul 29 16:54:01.086875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.086822 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="002ed67c-491c-4441-af2e-a44f6152bf50" containerName="console" Jul 29 16:54:01.086875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.086841 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" containerName="registry" Jul 29 16:54:01.086875 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.086847 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" containerName="registry" Jul 29 16:54:01.086966 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.086930 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fa45b4d-6f7c-4f8b-bf00-e5de0543df45" containerName="registry" Jul 29 16:54:01.086966 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.086938 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="002ed67c-491c-4441-af2e-a44f6152bf50" containerName="console" Jul 29 16:54:01.088767 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.088751 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.092620 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.092600 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 16:54:01.092910 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.092897 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 16:54:01.093149 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.093127 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j27tm\"" Jul 29 16:54:01.093291 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.093276 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 16:54:01.093560 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.093544 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 16:54:01.093695 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.093680 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 16:54:01.122603 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.122583 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-serving-cert\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.122690 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.122605 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-trusted-ca-bundle\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.122690 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.122620 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-oauth-serving-cert\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.122690 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.122635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kg72\" (UniqueName: \"kubernetes.io/projected/ce0b88b9-0b20-4041-a3c3-024c63d031bb-kube-api-access-2kg72\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.122690 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.122664 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-config\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.122814 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.122714 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-oauth-config\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.122814 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.122742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-service-ca\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.138811 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.138622 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 16:54:01.141828 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.141800 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf68c8bfd-6whdz"] Jul 29 16:54:01.223606 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.223578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-service-ca\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.223742 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.223621 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-serving-cert\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.223742 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.223645 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-trusted-ca-bundle\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.223858 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.223746 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-oauth-serving-cert\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.223858 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.223777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kg72\" (UniqueName: \"kubernetes.io/projected/ce0b88b9-0b20-4041-a3c3-024c63d031bb-kube-api-access-2kg72\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.223858 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.223827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-config\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.224020 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.223893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-oauth-config\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.224427 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.224399 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-service-ca\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.224527 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.224507 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-config\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.224640 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.224541 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-oauth-serving-cert\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.224728 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.224708 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-trusted-ca-bundle\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.225966 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.225940 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-serving-cert\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.226067 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.225990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-oauth-config\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.236784 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.236765 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kg72\" (UniqueName: \"kubernetes.io/projected/ce0b88b9-0b20-4041-a3c3-024c63d031bb-kube-api-access-2kg72\") pod \"console-bf68c8bfd-6whdz\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.335324 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.335250 2556 generic.go:356] "Generic (PLEG): container finished" podID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerID="cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115" exitCode=0 Jul 29 16:54:01.335324 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.335275 2556 generic.go:356] "Generic (PLEG): container finished" podID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerID="8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9" exitCode=0 Jul 29 16:54:01.335324 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.335283 2556 generic.go:356] "Generic (PLEG): container finished" podID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerID="2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548" exitCode=0 Jul 29 16:54:01.335324 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.335288 2556 generic.go:356] "Generic (PLEG): container finished" podID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerID="652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287" exitCode=0 Jul 29 16:54:01.335546 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.335323 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerDied","Data":"cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115"} Jul 29 16:54:01.335546 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.335383 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerDied","Data":"8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9"} Jul 29 16:54:01.335546 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.335409 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerDied","Data":"2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548"} Jul 29 16:54:01.335546 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.335433 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerDied","Data":"652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287"} Jul 29 16:54:01.398659 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.398634 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:01.539990 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:01.539953 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf68c8bfd-6whdz"] Jul 29 16:54:01.543618 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:54:01.543591 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0b88b9_0b20_4041_a3c3_024c63d031bb.slice/crio-807f43c94b1e7c42d5c71f250040817fb30cb6a77190c6c9930507c79fde5893 WatchSource:0}: Error finding container 807f43c94b1e7c42d5c71f250040817fb30cb6a77190c6c9930507c79fde5893: Status 404 returned error can't find the container with id 807f43c94b1e7c42d5c71f250040817fb30cb6a77190c6c9930507c79fde5893 Jul 29 16:54:02.262185 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.262154 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.334202 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334123 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-main-db\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334202 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334170 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-cluster-tls-config\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334211 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-web-config\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334249 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-volume\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334280 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334314 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-metrics-client-ca\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334343 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnr4q\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-kube-api-access-fnr4q\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334366 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-web\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334401 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-main-tls\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334733 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334431 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-out\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334733 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334474 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-tls-assets\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334733 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334478 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:54:02.334733 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334499 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-trusted-ca-bundle\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334733 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334529 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy\") pod \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\" (UID: \"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37\") " Jul 29 16:54:02.334977 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.334764 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-main-db\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.335471 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.335438 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:54:02.335813 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.335789 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:54:02.338830 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.338768 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-kube-api-access-fnr4q" (OuterVolumeSpecName: "kube-api-access-fnr4q") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "kube-api-access-fnr4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:54:02.338830 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.338783 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:54:02.339408 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.339366 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:54:02.339408 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.339366 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-out" (OuterVolumeSpecName: "config-out") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:54:02.339556 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.339474 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:54:02.339675 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.339653 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:54:02.340560 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.340530 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-volume" (OuterVolumeSpecName: "config-volume") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:54:02.341398 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.341375 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:54:02.342905 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.342881 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:54:02.343213 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.343184 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf68c8bfd-6whdz" event={"ID":"ce0b88b9-0b20-4041-a3c3-024c63d031bb","Type":"ContainerStarted","Data":"717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6"} Jul 29 16:54:02.343320 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.343274 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf68c8bfd-6whdz" event={"ID":"ce0b88b9-0b20-4041-a3c3-024c63d031bb","Type":"ContainerStarted","Data":"807f43c94b1e7c42d5c71f250040817fb30cb6a77190c6c9930507c79fde5893"} Jul 29 16:54:02.346622 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.346595 2556 generic.go:356] "Generic (PLEG): container finished" podID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerID="bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922" exitCode=0 Jul 29 16:54:02.346727 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.346625 2556 generic.go:356] "Generic (PLEG): container finished" podID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerID="cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f" exitCode=0 Jul 29 16:54:02.346727 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.346655 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.346727 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.346678 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerDied","Data":"bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922"} Jul 29 16:54:02.346884 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.346755 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerDied","Data":"cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f"} Jul 29 16:54:02.346884 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.346798 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0fa3bcdf-236d-4e31-a5cf-28bd8288fd37","Type":"ContainerDied","Data":"58ece61e6876d0a372156b3faca225816d1bd0976efe67deb00512674c280e95"} Jul 29 16:54:02.346884 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.346829 2556 scope.go:117] "RemoveContainer" containerID="cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115" Jul 29 16:54:02.350591 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.350569 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-web-config" (OuterVolumeSpecName: "web-config") pod "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" (UID: "0fa3bcdf-236d-4e31-a5cf-28bd8288fd37"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:54:02.354394 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.354375 2556 scope.go:117] "RemoveContainer" containerID="bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922" Jul 29 16:54:02.361207 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.361183 2556 scope.go:117] "RemoveContainer" containerID="8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9" Jul 29 16:54:02.367884 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.367867 2556 scope.go:117] "RemoveContainer" containerID="cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f" Jul 29 16:54:02.373368 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.373313 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bf68c8bfd-6whdz" podStartSLOduration=1.373294838 podStartE2EDuration="1.373294838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:54:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:54:02.372631179 +0000 UTC m=+185.335704079" watchObservedRunningTime="2026-07-29 16:54:02.373294838 +0000 UTC m=+185.336367738" Jul 29 16:54:02.374981 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.374965 2556 scope.go:117] "RemoveContainer" containerID="2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548" Jul 29 16:54:02.381777 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.381758 2556 scope.go:117] "RemoveContainer" containerID="652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287" Jul 29 16:54:02.388539 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.388522 2556 scope.go:117] "RemoveContainer" containerID="159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab" Jul 29 16:54:02.395152 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.395134 2556 scope.go:117] "RemoveContainer" containerID="cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115" Jul 29 16:54:02.395389 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:54:02.395367 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115\": container with ID starting with cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115 not found: ID does not exist" containerID="cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115" Jul 29 16:54:02.395430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.395400 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115"} err="failed to get container status \"cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115\": rpc error: code = NotFound desc = could not find container \"cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115\": container with ID starting with cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115 not found: ID does not exist" Jul 29 16:54:02.395430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.395419 2556 scope.go:117] "RemoveContainer" containerID="bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922" Jul 29 16:54:02.395644 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:54:02.395630 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922\": container with ID starting with bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922 not found: ID does not exist" containerID="bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922" Jul 29 16:54:02.395680 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.395647 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922"} err="failed to get container status \"bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922\": rpc error: code = NotFound desc = could not find container \"bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922\": container with ID starting with bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922 not found: ID does not exist" Jul 29 16:54:02.395680 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.395661 2556 scope.go:117] "RemoveContainer" containerID="8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9" Jul 29 16:54:02.395866 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:54:02.395850 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9\": container with ID starting with 8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9 not found: ID does not exist" containerID="8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9" Jul 29 16:54:02.395905 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.395871 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9"} err="failed to get container status \"8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9\": rpc error: code = NotFound desc = could not find container \"8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9\": container with ID starting with 8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9 not found: ID does not exist" Jul 29 16:54:02.395905 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.395884 2556 scope.go:117] "RemoveContainer" containerID="cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f" Jul 29 16:54:02.396132 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:54:02.396116 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f\": container with ID starting with cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f not found: ID does not exist" containerID="cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f" Jul 29 16:54:02.396186 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.396138 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f"} err="failed to get container status \"cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f\": rpc error: code = NotFound desc = could not find container \"cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f\": container with ID starting with cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f not found: ID does not exist" Jul 29 16:54:02.396186 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.396156 2556 scope.go:117] "RemoveContainer" containerID="2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548" Jul 29 16:54:02.396348 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:54:02.396333 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548\": container with ID starting with 2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548 not found: ID does not exist" containerID="2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548" Jul 29 16:54:02.396389 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.396352 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548"} err="failed to get container status \"2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548\": rpc error: code = NotFound desc = could not find container \"2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548\": container with ID starting with 2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548 not found: ID does not exist" Jul 29 16:54:02.396389 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.396363 2556 scope.go:117] "RemoveContainer" containerID="652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287" Jul 29 16:54:02.396576 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:54:02.396562 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287\": container with ID starting with 652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287 not found: ID does not exist" containerID="652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287" Jul 29 16:54:02.396621 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.396579 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287"} err="failed to get container status \"652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287\": rpc error: code = NotFound desc = could not find container \"652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287\": container with ID starting with 652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287 not found: ID does not exist" Jul 29 16:54:02.396621 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.396591 2556 scope.go:117] "RemoveContainer" containerID="159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab" Jul 29 16:54:02.396769 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:54:02.396741 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab\": container with ID starting with 159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab not found: ID does not exist" containerID="159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab" Jul 29 16:54:02.396818 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.396765 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab"} err="failed to get container status \"159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab\": rpc error: code = NotFound desc = could not find container \"159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab\": container with ID starting with 159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab not found: ID does not exist" Jul 29 16:54:02.396818 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.396783 2556 scope.go:117] "RemoveContainer" containerID="cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115" Jul 29 16:54:02.397005 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.396988 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115"} err="failed to get container status \"cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115\": rpc error: code = NotFound desc = could not find container \"cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115\": container with ID starting with cff1d99e50fd1865db5ce57b9249b41497c479c2c9c34ec031234f09dcc58115 not found: ID does not exist" Jul 29 16:54:02.397097 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397005 2556 scope.go:117] "RemoveContainer" containerID="bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922" Jul 29 16:54:02.397216 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397199 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922"} err="failed to get container status \"bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922\": rpc error: code = NotFound desc = could not find container \"bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922\": container with ID starting with bb43114886435759f3c6943eb5a61e3095d935a5c67fa61c3fcb9582bf215922 not found: ID does not exist" Jul 29 16:54:02.397275 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397216 2556 scope.go:117] "RemoveContainer" containerID="8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9" Jul 29 16:54:02.397390 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397375 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9"} err="failed to get container status \"8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9\": rpc error: code = NotFound desc = could not find container \"8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9\": container with ID starting with 8f44ae3dd4820d2c548f664317904afc0a16bfcde5b886e3d189f9f2022ed2d9 not found: ID does not exist" Jul 29 16:54:02.397437 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397390 2556 scope.go:117] "RemoveContainer" containerID="cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f" Jul 29 16:54:02.397597 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397583 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f"} err="failed to get container status \"cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f\": rpc error: code = NotFound desc = could not find container \"cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f\": container with ID starting with cfc59ce0a010e7d2960ed7c5d2fd2b91832560e54b35ea68a9d17e4e5fb03b6f not found: ID does not exist" Jul 29 16:54:02.397660 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397597 2556 scope.go:117] "RemoveContainer" containerID="2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548" Jul 29 16:54:02.397793 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397777 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548"} err="failed to get container status \"2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548\": rpc error: code = NotFound desc = could not find container \"2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548\": container with ID starting with 2988009bdc16aa316e0d398625c6c2d2b3b5610b9dda17fdb441a61a46aac548 not found: ID does not exist" Jul 29 16:54:02.397849 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397793 2556 scope.go:117] "RemoveContainer" containerID="652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287" Jul 29 16:54:02.397985 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397969 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287"} err="failed to get container status \"652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287\": rpc error: code = NotFound desc = could not find container \"652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287\": container with ID starting with 652344b205b71ddfc4f59da3b6efe6d24a5fba1cf90f6511c5ff944620001287 not found: ID does not exist" Jul 29 16:54:02.398031 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.397985 2556 scope.go:117] "RemoveContainer" containerID="159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab" Jul 29 16:54:02.398182 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.398163 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab"} err="failed to get container status \"159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab\": rpc error: code = NotFound desc = could not find container \"159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab\": container with ID starting with 159c3d34faae5319060a7954cc3c232a1596c99b8128796c79bc73f0f74b87ab not found: ID does not exist" Jul 29 16:54:02.435886 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435866 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-metrics-client-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435888 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnr4q\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-kube-api-access-fnr4q\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435904 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435918 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-main-tls\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435931 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-out\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435944 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-tls-assets\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435955 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435968 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435982 2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-cluster-tls-config\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.435993 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-web-config\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436011 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.436006 2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-config-volume\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.436452 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.436018 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:54:02.673176 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.673152 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:54:02.681367 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.681346 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:54:02.731761 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.731733 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:54:02.732125 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732108 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="prom-label-proxy" Jul 29 16:54:02.732215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732128 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="prom-label-proxy" Jul 29 16:54:02.732215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732141 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy-metric" Jul 29 16:54:02.732215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732149 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy-metric" Jul 29 16:54:02.732215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732160 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy" Jul 29 16:54:02.732215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732168 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy" Jul 29 16:54:02.732215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732182 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="config-reloader" Jul 29 16:54:02.732215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732191 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="config-reloader" Jul 29 16:54:02.732215 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732213 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="alertmanager" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732221 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="alertmanager" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732243 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="init-config-reloader" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732252 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="init-config-reloader" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732263 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy-web" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732272 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy-web" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732347 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732358 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="prom-label-proxy" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732373 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="alertmanager" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732381 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy-metric" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732392 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="kube-rbac-proxy-web" Jul 29 16:54:02.732623 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.732402 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" containerName="config-reloader" Jul 29 16:54:02.736023 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.736005 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.741298 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.741279 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 16:54:02.741429 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.741411 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 16:54:02.741548 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.741526 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 16:54:02.741548 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.741539 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 16:54:02.742126 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.742110 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 16:54:02.742214 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.742188 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 16:54:02.742214 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.742209 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 16:54:02.742324 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.742192 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 16:54:02.746315 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.746299 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tq7jd\"" Jul 29 16:54:02.751093 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.751075 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 16:54:02.770948 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.770917 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:54:02.839130 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839103 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-config-volume\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839223 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839135 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839223 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839223 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-config-out\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839223 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839359 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839359 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839284 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839359 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbdd6\" (UniqueName: \"kubernetes.io/projected/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-kube-api-access-dbdd6\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839359 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839340 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839483 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839366 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839483 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839483 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839437 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.839483 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.839456 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-web-config\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.940754 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.940754 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.940754 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940733 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbdd6\" (UniqueName: \"kubernetes.io/projected/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-kube-api-access-dbdd6\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.940754 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940771 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940805 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-web-config\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940875 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-config-volume\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.940973 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-config-out\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941037 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.941014 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941494 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.941448 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.941744 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.941691 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.942263 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.942231 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.944107 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.944007 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.944107 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.944038 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-config-out\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.944271 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.944173 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.944271 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.944202 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.944380 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.944336 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.944452 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.944434 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.944598 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.944582 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-config-volume\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.945280 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.945258 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.945280 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.945273 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-web-config\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:02.951773 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:02.951754 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbdd6\" (UniqueName: \"kubernetes.io/projected/3813f88f-7c70-41b4-b6af-3ea6cb68ffb9-kube-api-access-dbdd6\") pod \"alertmanager-main-0\" (UID: \"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:03.045265 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:03.045237 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 16:54:03.190024 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:03.189992 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 16:54:03.193191 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:54:03.193168 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3813f88f_7c70_41b4_b6af_3ea6cb68ffb9.slice/crio-d73997c6cbdb9a8a421238432697d63c1e330c6aede1a35fdfc04808b5295c60 WatchSource:0}: Error finding container d73997c6cbdb9a8a421238432697d63c1e330c6aede1a35fdfc04808b5295c60: Status 404 returned error can't find the container with id d73997c6cbdb9a8a421238432697d63c1e330c6aede1a35fdfc04808b5295c60 Jul 29 16:54:03.352483 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:03.352454 2556 generic.go:356] "Generic (PLEG): container finished" podID="3813f88f-7c70-41b4-b6af-3ea6cb68ffb9" containerID="48e920cdeb11d8eb0a06148589e35def6731cb287aac05d7464572c864371946" exitCode=0 Jul 29 16:54:03.352808 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:03.352539 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9","Type":"ContainerDied","Data":"48e920cdeb11d8eb0a06148589e35def6731cb287aac05d7464572c864371946"} Jul 29 16:54:03.352808 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:03.352598 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9","Type":"ContainerStarted","Data":"d73997c6cbdb9a8a421238432697d63c1e330c6aede1a35fdfc04808b5295c60"} Jul 29 16:54:03.533329 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:03.533295 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fa3bcdf-236d-4e31-a5cf-28bd8288fd37" path="/var/lib/kubelet/pods/0fa3bcdf-236d-4e31-a5cf-28bd8288fd37/volumes" Jul 29 16:54:04.359855 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:04.359815 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9","Type":"ContainerStarted","Data":"faca0312a94d1950258a8e05e6ff5072e81815e3506795ff789e66a1b5e85070"} Jul 29 16:54:04.360360 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:04.359899 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9","Type":"ContainerStarted","Data":"f4acfd35109218554e722f1aa2b168b6e35be1775b15e82e05de72a6da037a98"} Jul 29 16:54:04.360360 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:04.359939 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9","Type":"ContainerStarted","Data":"021d6dca7a13311857917e384115a4d861838a507c0d73492514c3145cd7e834"} Jul 29 16:54:04.360360 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:04.359982 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9","Type":"ContainerStarted","Data":"1571a78966f46ca2c2d9ba952029bd8dc07ecc8d454620bacaba9e0a078bb393"} Jul 29 16:54:04.360360 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:04.360025 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9","Type":"ContainerStarted","Data":"825d78d22c16b55a86d8c0b8dce86c4eec3784b6b4db477f60d3e8091043179b"} Jul 29 16:54:04.360360 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:04.360081 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3813f88f-7c70-41b4-b6af-3ea6cb68ffb9","Type":"ContainerStarted","Data":"1bcad0c4b8d1acf714315fc6544c7a38ce4deaa87c072c155301fc4513ccaccf"} Jul 29 16:54:11.398783 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:11.398749 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:11.399311 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:11.398819 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:11.403263 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:11.403241 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:54:11.426951 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:11.426906 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.407927354 podStartE2EDuration="9.42689124s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.963886ms" isStatefulPod=false podCreationTimestamp="2026-07-29 16:54:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:54:04.39772735 +0000 UTC m=+187.360800233" watchObservedRunningTime="2026-07-29 16:54:11.42689124 +0000 UTC m=+194.389964139" Jul 29 16:54:12.395968 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:54:12.395940 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:55:57.453008 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:55:57.452977 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 16:55:57.455661 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:55:57.455642 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 16:55:57.462865 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:55:57.462848 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 16:56:04.471809 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.471773 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd"] Jul 29 16:56:04.474285 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.474270 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.477551 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.477525 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 16:56:04.477716 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.477567 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9v757\"" Jul 29 16:56:04.477776 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.477765 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 16:56:04.486938 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.486918 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd"] Jul 29 16:56:04.595891 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.595858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.595891 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.595892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk2t9\" (UniqueName: \"kubernetes.io/projected/a16d2b26-930a-4476-9457-daf2503c0b7e-kube-api-access-vk2t9\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.596160 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.595993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.697408 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.697376 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.697545 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.697424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.697545 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.697443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk2t9\" (UniqueName: \"kubernetes.io/projected/a16d2b26-930a-4476-9457-daf2503c0b7e-kube-api-access-vk2t9\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.697809 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.697786 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.697874 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.697845 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.706054 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.706031 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk2t9\" (UniqueName: \"kubernetes.io/projected/a16d2b26-930a-4476-9457-daf2503c0b7e-kube-api-access-vk2t9\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.783138 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.783076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:04.904188 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.904164 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd"] Jul 29 16:56:04.906748 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:56:04.906721 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda16d2b26_930a_4476_9457_daf2503c0b7e.slice/crio-fe907fda9019f78f507f44133b5d6ef2d1b466c19c107cd5160068cec651216c WatchSource:0}: Error finding container fe907fda9019f78f507f44133b5d6ef2d1b466c19c107cd5160068cec651216c: Status 404 returned error can't find the container with id fe907fda9019f78f507f44133b5d6ef2d1b466c19c107cd5160068cec651216c Jul 29 16:56:04.908659 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:04.908645 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 16:56:05.814384 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:05.814343 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" event={"ID":"a16d2b26-930a-4476-9457-daf2503c0b7e","Type":"ContainerStarted","Data":"fe907fda9019f78f507f44133b5d6ef2d1b466c19c107cd5160068cec651216c"} Jul 29 16:56:11.842357 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:11.842321 2556 generic.go:356] "Generic (PLEG): container finished" podID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerID="26d3215aad06917077703abc4623ee9a182e258a37960c26e68c8daa50effaa9" exitCode=0 Jul 29 16:56:11.842742 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:11.842406 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" event={"ID":"a16d2b26-930a-4476-9457-daf2503c0b7e","Type":"ContainerDied","Data":"26d3215aad06917077703abc4623ee9a182e258a37960c26e68c8daa50effaa9"} Jul 29 16:56:13.852595 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:13.852566 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" event={"ID":"a16d2b26-930a-4476-9457-daf2503c0b7e","Type":"ContainerStarted","Data":"11d16f8313ab8d1eb5a8d98442787344e048278cd282e3725fa728eb75de9663"} Jul 29 16:56:14.857567 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:14.857531 2556 generic.go:356] "Generic (PLEG): container finished" podID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerID="11d16f8313ab8d1eb5a8d98442787344e048278cd282e3725fa728eb75de9663" exitCode=0 Jul 29 16:56:14.858007 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:14.857626 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" event={"ID":"a16d2b26-930a-4476-9457-daf2503c0b7e","Type":"ContainerDied","Data":"11d16f8313ab8d1eb5a8d98442787344e048278cd282e3725fa728eb75de9663"} Jul 29 16:56:21.890797 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:21.890765 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" event={"ID":"a16d2b26-930a-4476-9457-daf2503c0b7e","Type":"ContainerStarted","Data":"8c32a254ff592d5f6167ba988ca2bfcb82e740d2151e27d950c789f0a3bba31a"} Jul 29 16:56:21.908412 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:21.908363 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" podStartSLOduration=3.042247996 podStartE2EDuration="17.908346955s" totalImagesPullingTime="14.866098959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:56:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:56:21.908099087 +0000 UTC m=+324.871171987" watchObservedRunningTime="2026-07-29 16:56:21.908346955 +0000 UTC m=+324.871419854" Jul 29 16:56:22.896133 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:22.896100 2556 generic.go:356] "Generic (PLEG): container finished" podID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerID="8c32a254ff592d5f6167ba988ca2bfcb82e740d2151e27d950c789f0a3bba31a" exitCode=0 Jul 29 16:56:22.896531 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:22.896144 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" event={"ID":"a16d2b26-930a-4476-9457-daf2503c0b7e","Type":"ContainerDied","Data":"8c32a254ff592d5f6167ba988ca2bfcb82e740d2151e27d950c789f0a3bba31a"} Jul 29 16:56:24.023217 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.023193 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:24.170834 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.170755 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-util\") pod \"a16d2b26-930a-4476-9457-daf2503c0b7e\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " Jul 29 16:56:24.170834 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.170822 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk2t9\" (UniqueName: \"kubernetes.io/projected/a16d2b26-930a-4476-9457-daf2503c0b7e-kube-api-access-vk2t9\") pod \"a16d2b26-930a-4476-9457-daf2503c0b7e\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " Jul 29 16:56:24.171041 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.170858 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-bundle\") pod \"a16d2b26-930a-4476-9457-daf2503c0b7e\" (UID: \"a16d2b26-930a-4476-9457-daf2503c0b7e\") " Jul 29 16:56:24.171551 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.171523 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-bundle" (OuterVolumeSpecName: "bundle") pod "a16d2b26-930a-4476-9457-daf2503c0b7e" (UID: "a16d2b26-930a-4476-9457-daf2503c0b7e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:56:24.172918 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.172891 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a16d2b26-930a-4476-9457-daf2503c0b7e-kube-api-access-vk2t9" (OuterVolumeSpecName: "kube-api-access-vk2t9") pod "a16d2b26-930a-4476-9457-daf2503c0b7e" (UID: "a16d2b26-930a-4476-9457-daf2503c0b7e"). InnerVolumeSpecName "kube-api-access-vk2t9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:56:24.175903 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.175877 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-util" (OuterVolumeSpecName: "util") pod "a16d2b26-930a-4476-9457-daf2503c0b7e" (UID: "a16d2b26-930a-4476-9457-daf2503c0b7e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:56:24.271885 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.271862 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-bundle\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:56:24.271885 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.271883 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a16d2b26-930a-4476-9457-daf2503c0b7e-util\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:56:24.272021 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.271892 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk2t9\" (UniqueName: \"kubernetes.io/projected/a16d2b26-930a-4476-9457-daf2503c0b7e-kube-api-access-vk2t9\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:56:24.905450 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.905422 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" Jul 29 16:56:24.905639 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.905423 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5wxmsd" event={"ID":"a16d2b26-930a-4476-9457-daf2503c0b7e","Type":"ContainerDied","Data":"fe907fda9019f78f507f44133b5d6ef2d1b466c19c107cd5160068cec651216c"} Jul 29 16:56:24.905639 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:24.905548 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe907fda9019f78f507f44133b5d6ef2d1b466c19c107cd5160068cec651216c" Jul 29 16:56:27.381835 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.381789 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj"] Jul 29 16:56:27.382317 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.382110 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerName="util" Jul 29 16:56:27.382317 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.382121 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerName="util" Jul 29 16:56:27.382317 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.382137 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerName="extract" Jul 29 16:56:27.382317 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.382143 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerName="extract" Jul 29 16:56:27.382317 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.382155 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerName="pull" Jul 29 16:56:27.382317 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.382160 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerName="pull" Jul 29 16:56:27.382317 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.382211 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a16d2b26-930a-4476-9457-daf2503c0b7e" containerName="extract" Jul 29 16:56:27.385194 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.385178 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:27.387761 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.387736 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 29 16:56:27.387909 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.387806 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-2qsgj\"" Jul 29 16:56:27.387909 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.387813 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 29 16:56:27.388116 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.388102 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 29 16:56:27.397081 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.397042 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj"] Jul 29 16:56:27.495990 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.495964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp25f\" (UniqueName: \"kubernetes.io/projected/27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e-kube-api-access-mp25f\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj\" (UID: \"27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:27.496150 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.496034 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj\" (UID: \"27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:27.596591 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.596550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj\" (UID: \"27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:27.596744 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.596604 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp25f\" (UniqueName: \"kubernetes.io/projected/27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e-kube-api-access-mp25f\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj\" (UID: \"27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:27.598744 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.598725 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj\" (UID: \"27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:27.605318 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.605295 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp25f\" (UniqueName: \"kubernetes.io/projected/27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e-kube-api-access-mp25f\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj\" (UID: \"27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:27.695063 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.694956 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:27.840490 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.840466 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj"] Jul 29 16:56:27.841824 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:56:27.841794 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e8f8fe_fe00_4b67_8f25_e4ecfbdbe01e.slice/crio-93149b2c02c3e2b9276ba87cf705493bf4f3ac121b0e27c95d3ec4c7f356d32c WatchSource:0}: Error finding container 93149b2c02c3e2b9276ba87cf705493bf4f3ac121b0e27c95d3ec4c7f356d32c: Status 404 returned error can't find the container with id 93149b2c02c3e2b9276ba87cf705493bf4f3ac121b0e27c95d3ec4c7f356d32c Jul 29 16:56:27.918244 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:27.918206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" event={"ID":"27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e","Type":"ContainerStarted","Data":"93149b2c02c3e2b9276ba87cf705493bf4f3ac121b0e27c95d3ec4c7f356d32c"} Jul 29 16:56:30.935002 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:30.934921 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" event={"ID":"27e8f8fe-fe00-4b67-8f25-e4ecfbdbe01e","Type":"ContainerStarted","Data":"b7911e2ba2c02b07db0323ce8a6d7db504f49405023999508a0872b3c66f8d5e"} Jul 29 16:56:30.935478 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:30.935019 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:30.961464 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:30.961411 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" podStartSLOduration=1.266121662 podStartE2EDuration="3.961395304s" totalImagesPullingTime="2.695273642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:56:30.959034578 +0000 UTC m=+333.922107471" watchObservedRunningTime="2026-07-29 16:56:30.961395304 +0000 UTC m=+333.924468203" Jul 29 16:56:31.259946 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.259914 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-wbg48"] Jul 29 16:56:31.263148 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.263133 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:31.267457 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.267436 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 29 16:56:31.267597 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.267473 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 29 16:56:31.267597 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.267550 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-t8mks\"" Jul 29 16:56:31.281083 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.281038 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-wbg48"] Jul 29 16:56:31.427195 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.427169 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/9f23c83b-3c33-4baa-818a-49149b8ba665-cabundle0\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:31.427195 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.427198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-certificates\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:31.427383 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.427253 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds8qk\" (UniqueName: \"kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-kube-api-access-ds8qk\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:31.527758 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.527680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds8qk\" (UniqueName: \"kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-kube-api-access-ds8qk\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:31.527758 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.527749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/9f23c83b-3c33-4baa-818a-49149b8ba665-cabundle0\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:31.527964 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.527778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-certificates\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:31.527964 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:31.527891 2556 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found Jul 29 16:56:31.527964 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:31.527910 2556 secret.go:281] references non-existent secret key: ca.crt Jul 29 16:56:31.527964 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:31.527920 2556 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 16:56:31.527964 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:31.527936 2556 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-wbg48: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 29 16:56:31.528225 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:31.528013 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-certificates podName:9f23c83b-3c33-4baa-818a-49149b8ba665 nodeName:}" failed. No retries permitted until 2026-07-29 16:56:32.027992047 +0000 UTC m=+334.991064925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-certificates") pod "keda-operator-77f648d694-wbg48" (UID: "9f23c83b-3c33-4baa-818a-49149b8ba665") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt] Jul 29 16:56:31.528427 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.528410 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/9f23c83b-3c33-4baa-818a-49149b8ba665-cabundle0\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:31.538895 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.538868 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds8qk\" (UniqueName: \"kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-kube-api-access-ds8qk\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:31.724772 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.724741 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l"] Jul 29 16:56:31.728304 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.728284 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:31.731614 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.731594 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 29 16:56:31.741407 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.741384 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l"] Jul 29 16:56:31.830828 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.830750 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/21582305-9d7d-44a6-8405-72277d008866-certificates\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:31.830828 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.830790 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/21582305-9d7d-44a6-8405-72277d008866-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:31.830828 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.830808 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26hmx\" (UniqueName: \"kubernetes.io/projected/21582305-9d7d-44a6-8405-72277d008866-kube-api-access-26hmx\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:31.932041 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.932003 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/21582305-9d7d-44a6-8405-72277d008866-certificates\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:31.932041 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.932067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/21582305-9d7d-44a6-8405-72277d008866-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:31.932315 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.932092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26hmx\" (UniqueName: \"kubernetes.io/projected/21582305-9d7d-44a6-8405-72277d008866-kube-api-access-26hmx\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:31.932315 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:31.932143 2556 secret.go:281] references non-existent secret key: tls.crt Jul 29 16:56:31.932315 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:31.932162 2556 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 29 16:56:31.932315 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:31.932180 2556 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l: references non-existent secret key: tls.crt Jul 29 16:56:31.932315 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:31.932233 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21582305-9d7d-44a6-8405-72277d008866-certificates podName:21582305-9d7d-44a6-8405-72277d008866 nodeName:}" failed. No retries permitted until 2026-07-29 16:56:32.432218029 +0000 UTC m=+335.395290906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/21582305-9d7d-44a6-8405-72277d008866-certificates") pod "keda-metrics-apiserver-55557df8c-hqj2l" (UID: "21582305-9d7d-44a6-8405-72277d008866") : references non-existent secret key: tls.crt Jul 29 16:56:31.932503 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.932359 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/21582305-9d7d-44a6-8405-72277d008866-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:31.944614 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:31.944576 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26hmx\" (UniqueName: \"kubernetes.io/projected/21582305-9d7d-44a6-8405-72277d008866-kube-api-access-26hmx\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:32.033168 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:32.033139 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-certificates\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:32.033321 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:32.033255 2556 secret.go:281] references non-existent secret key: ca.crt Jul 29 16:56:32.033321 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:32.033277 2556 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 16:56:32.033321 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:32.033287 2556 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-wbg48: references non-existent secret key: ca.crt Jul 29 16:56:32.033418 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:56:32.033347 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-certificates podName:9f23c83b-3c33-4baa-818a-49149b8ba665 nodeName:}" failed. No retries permitted until 2026-07-29 16:56:33.033329249 +0000 UTC m=+335.996402149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-certificates") pod "keda-operator-77f648d694-wbg48" (UID: "9f23c83b-3c33-4baa-818a-49149b8ba665") : references non-existent secret key: ca.crt Jul 29 16:56:32.435807 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:32.435775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/21582305-9d7d-44a6-8405-72277d008866-certificates\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:32.438432 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:32.438405 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/21582305-9d7d-44a6-8405-72277d008866-certificates\") pod \"keda-metrics-apiserver-55557df8c-hqj2l\" (UID: \"21582305-9d7d-44a6-8405-72277d008866\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:32.638851 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:32.638820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:32.761585 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:32.761534 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l"] Jul 29 16:56:32.764259 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:56:32.764229 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21582305_9d7d_44a6_8405_72277d008866.slice/crio-6fed3e1c1417e44071d4296a992b962821d80dd4b1dbae5ee2306370777853ef WatchSource:0}: Error finding container 6fed3e1c1417e44071d4296a992b962821d80dd4b1dbae5ee2306370777853ef: Status 404 returned error can't find the container with id 6fed3e1c1417e44071d4296a992b962821d80dd4b1dbae5ee2306370777853ef Jul 29 16:56:32.945392 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:32.945313 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" event={"ID":"21582305-9d7d-44a6-8405-72277d008866","Type":"ContainerStarted","Data":"6fed3e1c1417e44071d4296a992b962821d80dd4b1dbae5ee2306370777853ef"} Jul 29 16:56:33.041362 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:33.041331 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-certificates\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:33.043737 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:33.043699 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9f23c83b-3c33-4baa-818a-49149b8ba665-certificates\") pod \"keda-operator-77f648d694-wbg48\" (UID: \"9f23c83b-3c33-4baa-818a-49149b8ba665\") " pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:33.072369 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:33.072344 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:33.202513 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:33.202484 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-wbg48"] Jul 29 16:56:33.204812 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:56:33.204789 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f23c83b_3c33_4baa_818a_49149b8ba665.slice/crio-235f04097c357a6277864fb6024a6f39ddaf4f91816349480b7640da3a675d90 WatchSource:0}: Error finding container 235f04097c357a6277864fb6024a6f39ddaf4f91816349480b7640da3a675d90: Status 404 returned error can't find the container with id 235f04097c357a6277864fb6024a6f39ddaf4f91816349480b7640da3a675d90 Jul 29 16:56:33.958465 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:33.958426 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-wbg48" event={"ID":"9f23c83b-3c33-4baa-818a-49149b8ba665","Type":"ContainerStarted","Data":"235f04097c357a6277864fb6024a6f39ddaf4f91816349480b7640da3a675d90"} Jul 29 16:56:37.980758 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:37.980719 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-wbg48" event={"ID":"9f23c83b-3c33-4baa-818a-49149b8ba665","Type":"ContainerStarted","Data":"36cd47347321ec83dbd67065d41c23042396616aa306c3e24de28c66d3388d18"} Jul 29 16:56:37.981224 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:37.980893 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:56:37.982232 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:37.982197 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" event={"ID":"21582305-9d7d-44a6-8405-72277d008866","Type":"ContainerStarted","Data":"560863cc4dbc0b2d5b4922e64341d1cd422b1346c23d4cf1edb77a5476c9b7f1"} Jul 29 16:56:37.982374 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:37.982331 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:37.999169 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:37.999120 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-wbg48" podStartSLOduration=3.102442051 podStartE2EDuration="6.999103574s" totalImagesPullingTime="3.896661523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:56:37.997690097 +0000 UTC m=+340.960762997" watchObservedRunningTime="2026-07-29 16:56:37.999103574 +0000 UTC m=+340.962176473" Jul 29 16:56:38.027150 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:38.027108 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" podStartSLOduration=2.687940375 podStartE2EDuration="7.027094609s" totalImagesPullingTime="4.339154234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:56:38.025032241 +0000 UTC m=+340.988105139" watchObservedRunningTime="2026-07-29 16:56:38.027094609 +0000 UTC m=+340.990167507" Jul 29 16:56:48.990989 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:48.990953 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-hqj2l" Jul 29 16:56:51.942817 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:51.942789 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2kcvj" Jul 29 16:56:58.989091 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:56:58.989063 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-wbg48" Jul 29 16:57:41.272006 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.271966 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-h8m4z"] Jul 29 16:57:41.274460 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.274439 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:41.286587 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.286565 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 29 16:57:41.286730 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.286595 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 16:57:41.286730 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.286631 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 16:57:41.286838 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.286737 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-xhdhx\"" Jul 29 16:57:41.287428 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.287412 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-h8m4z"] Jul 29 16:57:41.294424 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.294400 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qzjv\" (UniqueName: \"kubernetes.io/projected/4874ff68-c794-4996-ac3b-36645ce74868-kube-api-access-5qzjv\") pod \"llmisvc-controller-manager-67d95fdc48-h8m4z\" (UID: \"4874ff68-c794-4996-ac3b-36645ce74868\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:41.294536 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.294515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4874ff68-c794-4996-ac3b-36645ce74868-cert\") pod \"llmisvc-controller-manager-67d95fdc48-h8m4z\" (UID: \"4874ff68-c794-4996-ac3b-36645ce74868\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:41.313839 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.313810 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-8445dbf85d-mqfgb"] Jul 29 16:57:41.316533 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.316517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:41.320987 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.320968 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 29 16:57:41.321756 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.321729 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-stzcc\"" Jul 29 16:57:41.329920 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.329900 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-8445dbf85d-mqfgb"] Jul 29 16:57:41.395095 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.395037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4874ff68-c794-4996-ac3b-36645ce74868-cert\") pod \"llmisvc-controller-manager-67d95fdc48-h8m4z\" (UID: \"4874ff68-c794-4996-ac3b-36645ce74868\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:41.395263 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.395108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gctlq\" (UniqueName: \"kubernetes.io/projected/cb371505-5671-4593-b71f-6eb685758dbd-kube-api-access-gctlq\") pod \"seaweedfs-8445dbf85d-mqfgb\" (UID: \"cb371505-5671-4593-b71f-6eb685758dbd\") " pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:41.395263 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.395143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qzjv\" (UniqueName: \"kubernetes.io/projected/4874ff68-c794-4996-ac3b-36645ce74868-kube-api-access-5qzjv\") pod \"llmisvc-controller-manager-67d95fdc48-h8m4z\" (UID: \"4874ff68-c794-4996-ac3b-36645ce74868\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:41.395263 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.395201 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cb371505-5671-4593-b71f-6eb685758dbd-data\") pod \"seaweedfs-8445dbf85d-mqfgb\" (UID: \"cb371505-5671-4593-b71f-6eb685758dbd\") " pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:41.397421 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.397394 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4874ff68-c794-4996-ac3b-36645ce74868-cert\") pod \"llmisvc-controller-manager-67d95fdc48-h8m4z\" (UID: \"4874ff68-c794-4996-ac3b-36645ce74868\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:41.407128 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.407107 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qzjv\" (UniqueName: \"kubernetes.io/projected/4874ff68-c794-4996-ac3b-36645ce74868-kube-api-access-5qzjv\") pod \"llmisvc-controller-manager-67d95fdc48-h8m4z\" (UID: \"4874ff68-c794-4996-ac3b-36645ce74868\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:41.496379 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.496340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cb371505-5671-4593-b71f-6eb685758dbd-data\") pod \"seaweedfs-8445dbf85d-mqfgb\" (UID: \"cb371505-5671-4593-b71f-6eb685758dbd\") " pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:41.496553 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.496413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gctlq\" (UniqueName: \"kubernetes.io/projected/cb371505-5671-4593-b71f-6eb685758dbd-kube-api-access-gctlq\") pod \"seaweedfs-8445dbf85d-mqfgb\" (UID: \"cb371505-5671-4593-b71f-6eb685758dbd\") " pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:41.496795 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.496774 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cb371505-5671-4593-b71f-6eb685758dbd-data\") pod \"seaweedfs-8445dbf85d-mqfgb\" (UID: \"cb371505-5671-4593-b71f-6eb685758dbd\") " pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:41.505660 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.505623 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gctlq\" (UniqueName: \"kubernetes.io/projected/cb371505-5671-4593-b71f-6eb685758dbd-kube-api-access-gctlq\") pod \"seaweedfs-8445dbf85d-mqfgb\" (UID: \"cb371505-5671-4593-b71f-6eb685758dbd\") " pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:41.588168 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.588079 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:41.625140 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.625110 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:41.727643 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.727596 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-h8m4z"] Jul 29 16:57:41.729529 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:57:41.729497 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4874ff68_c794_4996_ac3b_36645ce74868.slice/crio-b0813da4c7102bdc65a0ae077157a02e33a598003c97ce21dc298320cbdfa489 WatchSource:0}: Error finding container b0813da4c7102bdc65a0ae077157a02e33a598003c97ce21dc298320cbdfa489: Status 404 returned error can't find the container with id b0813da4c7102bdc65a0ae077157a02e33a598003c97ce21dc298320cbdfa489 Jul 29 16:57:41.771538 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:41.771515 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-8445dbf85d-mqfgb"] Jul 29 16:57:41.773484 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:57:41.773456 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb371505_5671_4593_b71f_6eb685758dbd.slice/crio-d39f5d166dce998f35b0ad9f2d5110a384c09ae2e17439105ba9380cc1f1c334 WatchSource:0}: Error finding container d39f5d166dce998f35b0ad9f2d5110a384c09ae2e17439105ba9380cc1f1c334: Status 404 returned error can't find the container with id d39f5d166dce998f35b0ad9f2d5110a384c09ae2e17439105ba9380cc1f1c334 Jul 29 16:57:42.264216 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:42.264176 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerStarted","Data":"b0813da4c7102bdc65a0ae077157a02e33a598003c97ce21dc298320cbdfa489"} Jul 29 16:57:42.265612 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:42.265585 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-8445dbf85d-mqfgb" event={"ID":"cb371505-5671-4593-b71f-6eb685758dbd","Type":"ContainerStarted","Data":"d39f5d166dce998f35b0ad9f2d5110a384c09ae2e17439105ba9380cc1f1c334"} Jul 29 16:57:45.282555 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:45.282518 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-8445dbf85d-mqfgb" event={"ID":"cb371505-5671-4593-b71f-6eb685758dbd","Type":"ContainerStarted","Data":"12f4bb0939fecaf82146261f05bf75b78fe6cca317005a984b9466c21c6cd61c"} Jul 29 16:57:45.282967 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:45.282577 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:45.284002 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:45.283977 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerStarted","Data":"6a15ca7d3c02929c4489b349f82165bdd05dc69830faaa5ccbf65b6bf630c4a5"} Jul 29 16:57:45.284133 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:45.284097 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:45.303427 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:45.303382 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-8445dbf85d-mqfgb" podStartSLOduration=1.008260894 podStartE2EDuration="4.303365988s" totalImagesPullingTime="3.295105094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:57:45.302569696 +0000 UTC m=+408.265642591" watchObservedRunningTime="2026-07-29 16:57:45.303365988 +0000 UTC m=+408.266438884" Jul 29 16:57:45.320650 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:45.320608 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podStartSLOduration=1.036182996 podStartE2EDuration="4.320592938s" totalImagesPullingTime="3.284409942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:57:45.319598439 +0000 UTC m=+408.282671338" watchObservedRunningTime="2026-07-29 16:57:45.320592938 +0000 UTC m=+408.283665838" Jul 29 16:57:46.289894 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:46.289864 2556 generic.go:356] "Generic (PLEG): container finished" podID="4874ff68-c794-4996-ac3b-36645ce74868" containerID="6a15ca7d3c02929c4489b349f82165bdd05dc69830faaa5ccbf65b6bf630c4a5" exitCode=1 Jul 29 16:57:46.290292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:46.289950 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerDied","Data":"6a15ca7d3c02929c4489b349f82165bdd05dc69830faaa5ccbf65b6bf630c4a5"} Jul 29 16:57:46.290292 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:46.290153 2556 scope.go:117] "RemoveContainer" containerID="6a15ca7d3c02929c4489b349f82165bdd05dc69830faaa5ccbf65b6bf630c4a5" Jul 29 16:57:47.296515 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:47.296483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerStarted","Data":"f487927754ff2557d1177b017fda1e8233713d920a3d07c06e6da0997022051e"} Jul 29 16:57:47.296966 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:47.296578 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:48.302355 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:48.302320 2556 generic.go:356] "Generic (PLEG): container finished" podID="4874ff68-c794-4996-ac3b-36645ce74868" containerID="f487927754ff2557d1177b017fda1e8233713d920a3d07c06e6da0997022051e" exitCode=1 Jul 29 16:57:48.302769 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:48.302369 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerDied","Data":"f487927754ff2557d1177b017fda1e8233713d920a3d07c06e6da0997022051e"} Jul 29 16:57:48.302769 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:48.302419 2556 scope.go:117] "RemoveContainer" containerID="6a15ca7d3c02929c4489b349f82165bdd05dc69830faaa5ccbf65b6bf630c4a5" Jul 29 16:57:48.302769 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:48.302570 2556 scope.go:117] "RemoveContainer" containerID="f487927754ff2557d1177b017fda1e8233713d920a3d07c06e6da0997022051e" Jul 29 16:57:48.302883 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:57:48.302785 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:57:49.308278 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:49.308247 2556 scope.go:117] "RemoveContainer" containerID="f487927754ff2557d1177b017fda1e8233713d920a3d07c06e6da0997022051e" Jul 29 16:57:49.308667 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:57:49.308437 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:57:51.291926 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:51.291901 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-8445dbf85d-mqfgb" Jul 29 16:57:51.588444 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:51.588367 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:57:51.588692 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:57:51.588679 2556 scope.go:117] "RemoveContainer" containerID="f487927754ff2557d1177b017fda1e8233713d920a3d07c06e6da0997022051e" Jul 29 16:57:51.588859 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:57:51.588841 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:58:02.528724 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:02.528694 2556 scope.go:117] "RemoveContainer" containerID="f487927754ff2557d1177b017fda1e8233713d920a3d07c06e6da0997022051e" Jul 29 16:58:03.374573 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:03.374539 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerStarted","Data":"cf5910cf06950a699ac9d09f38ad9717e320921b4c9283a46e18e8a0aac9b6d0"} Jul 29 16:58:03.374746 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:03.374730 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:58:04.380257 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:04.380222 2556 generic.go:356] "Generic (PLEG): container finished" podID="4874ff68-c794-4996-ac3b-36645ce74868" containerID="cf5910cf06950a699ac9d09f38ad9717e320921b4c9283a46e18e8a0aac9b6d0" exitCode=1 Jul 29 16:58:04.380671 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:04.380305 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerDied","Data":"cf5910cf06950a699ac9d09f38ad9717e320921b4c9283a46e18e8a0aac9b6d0"} Jul 29 16:58:04.380671 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:04.380361 2556 scope.go:117] "RemoveContainer" containerID="f487927754ff2557d1177b017fda1e8233713d920a3d07c06e6da0997022051e" Jul 29 16:58:04.380671 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:04.380575 2556 scope.go:117] "RemoveContainer" containerID="cf5910cf06950a699ac9d09f38ad9717e320921b4c9283a46e18e8a0aac9b6d0" Jul 29 16:58:04.380791 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:58:04.380749 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:58:05.386005 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:05.385981 2556 scope.go:117] "RemoveContainer" containerID="cf5910cf06950a699ac9d09f38ad9717e320921b4c9283a46e18e8a0aac9b6d0" Jul 29 16:58:05.386372 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:58:05.386183 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:58:06.196613 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.196574 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8d5d549b6-ll9md"] Jul 29 16:58:06.201609 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.201585 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.217823 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.217794 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d5d549b6-ll9md"] Jul 29 16:58:06.291511 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.291479 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b42ff2-c16d-4918-b513-1dce0441cf56-console-serving-cert\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.291669 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.291534 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0b42ff2-c16d-4918-b513-1dce0441cf56-console-oauth-config\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.291669 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.291574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-console-config\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.291669 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.291609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxdkb\" (UniqueName: \"kubernetes.io/projected/d0b42ff2-c16d-4918-b513-1dce0441cf56-kube-api-access-wxdkb\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.291669 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.291660 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-service-ca\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.291823 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.291700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-trusted-ca-bundle\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.291823 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.291731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-oauth-serving-cert\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.392703 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.392669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-trusted-ca-bundle\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393124 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.392726 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-oauth-serving-cert\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393124 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.392758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b42ff2-c16d-4918-b513-1dce0441cf56-console-serving-cert\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393124 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.392823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0b42ff2-c16d-4918-b513-1dce0441cf56-console-oauth-config\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393124 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.392849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-console-config\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393124 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.392886 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxdkb\" (UniqueName: \"kubernetes.io/projected/d0b42ff2-c16d-4918-b513-1dce0441cf56-kube-api-access-wxdkb\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393124 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.392933 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-service-ca\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393577 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.393548 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-oauth-serving-cert\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393674 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.393601 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-trusted-ca-bundle\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393674 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.393625 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-service-ca\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.393866 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.393846 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0b42ff2-c16d-4918-b513-1dce0441cf56-console-config\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.395238 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.395209 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0b42ff2-c16d-4918-b513-1dce0441cf56-console-serving-cert\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.395326 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.395272 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0b42ff2-c16d-4918-b513-1dce0441cf56-console-oauth-config\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.401989 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.401966 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxdkb\" (UniqueName: \"kubernetes.io/projected/d0b42ff2-c16d-4918-b513-1dce0441cf56-kube-api-access-wxdkb\") pod \"console-8d5d549b6-ll9md\" (UID: \"d0b42ff2-c16d-4918-b513-1dce0441cf56\") " pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.511430 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.511396 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:06.648151 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:06.648124 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d5d549b6-ll9md"] Jul 29 16:58:06.650032 ip-10-0-132-134 kubenswrapper[2556]: W0729 16:58:06.650005 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b42ff2_c16d_4918_b513_1dce0441cf56.slice/crio-3930f83f50d25bc07e62f74de45676e819201c35e9e2827d5cfce3ff33fd4a5e WatchSource:0}: Error finding container 3930f83f50d25bc07e62f74de45676e819201c35e9e2827d5cfce3ff33fd4a5e: Status 404 returned error can't find the container with id 3930f83f50d25bc07e62f74de45676e819201c35e9e2827d5cfce3ff33fd4a5e Jul 29 16:58:07.395850 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:07.395816 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d5d549b6-ll9md" event={"ID":"d0b42ff2-c16d-4918-b513-1dce0441cf56","Type":"ContainerStarted","Data":"9e618c5d8e22f979cd31f378efdde13d9213f2576508acf3db5ae45bf803de84"} Jul 29 16:58:07.396269 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:07.395866 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d5d549b6-ll9md" event={"ID":"d0b42ff2-c16d-4918-b513-1dce0441cf56","Type":"ContainerStarted","Data":"3930f83f50d25bc07e62f74de45676e819201c35e9e2827d5cfce3ff33fd4a5e"} Jul 29 16:58:07.427403 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:07.427348 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8d5d549b6-ll9md" podStartSLOduration=1.42733349 podStartE2EDuration="1.42733349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:58:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:58:07.426093612 +0000 UTC m=+430.389166513" watchObservedRunningTime="2026-07-29 16:58:07.42733349 +0000 UTC m=+430.390406388" Jul 29 16:58:11.588803 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:11.588768 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:58:11.589274 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:11.589141 2556 scope.go:117] "RemoveContainer" containerID="cf5910cf06950a699ac9d09f38ad9717e320921b4c9283a46e18e8a0aac9b6d0" Jul 29 16:58:11.589324 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:58:11.589305 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:58:16.512121 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:16.512088 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:16.512500 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:16.512139 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:16.516642 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:16.516620 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:17.448151 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:17.448119 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8d5d549b6-ll9md" Jul 29 16:58:17.498841 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:17.498807 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf68c8bfd-6whdz"] Jul 29 16:58:22.528817 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:22.528747 2556 scope.go:117] "RemoveContainer" containerID="cf5910cf06950a699ac9d09f38ad9717e320921b4c9283a46e18e8a0aac9b6d0" Jul 29 16:58:22.529191 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:58:22.528912 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:58:37.534437 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:37.534410 2556 scope.go:117] "RemoveContainer" containerID="cf5910cf06950a699ac9d09f38ad9717e320921b4c9283a46e18e8a0aac9b6d0" Jul 29 16:58:38.534132 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:38.534094 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerStarted","Data":"3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04"} Jul 29 16:58:38.534317 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:38.534300 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:58:39.539363 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:39.539331 2556 generic.go:356] "Generic (PLEG): container finished" podID="4874ff68-c794-4996-ac3b-36645ce74868" containerID="3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04" exitCode=1 Jul 29 16:58:39.539815 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:39.539376 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerDied","Data":"3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04"} Jul 29 16:58:39.539815 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:39.539420 2556 scope.go:117] "RemoveContainer" containerID="cf5910cf06950a699ac9d09f38ad9717e320921b4c9283a46e18e8a0aac9b6d0" Jul 29 16:58:39.539815 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:39.539551 2556 scope.go:117] "RemoveContainer" containerID="3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04" Jul 29 16:58:39.539815 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:58:39.539740 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:58:40.545195 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:40.545171 2556 scope.go:117] "RemoveContainer" containerID="3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04" Jul 29 16:58:40.545557 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:58:40.545330 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:58:41.588945 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:41.588915 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:58:41.589338 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:41.589254 2556 scope.go:117] "RemoveContainer" containerID="3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04" Jul 29 16:58:41.589419 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:58:41.589400 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:58:42.518960 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.518915 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bf68c8bfd-6whdz" podUID="ce0b88b9-0b20-4041-a3c3-024c63d031bb" containerName="console" containerID="cri-o://717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6" gracePeriod=15 Jul 29 16:58:42.763808 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.763777 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:58:42.791195 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791134 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-oauth-serving-cert\") pod \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " Jul 29 16:58:42.791351 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791202 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-config\") pod \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " Jul 29 16:58:42.791411 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791346 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-service-ca\") pod \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " Jul 29 16:58:42.791411 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791400 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kg72\" (UniqueName: \"kubernetes.io/projected/ce0b88b9-0b20-4041-a3c3-024c63d031bb-kube-api-access-2kg72\") pod \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " Jul 29 16:58:42.791504 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791431 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-oauth-config\") pod \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " Jul 29 16:58:42.791554 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791536 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ce0b88b9-0b20-4041-a3c3-024c63d031bb" (UID: "ce0b88b9-0b20-4041-a3c3-024c63d031bb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:58:42.791670 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791564 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-config" (OuterVolumeSpecName: "console-config") pod "ce0b88b9-0b20-4041-a3c3-024c63d031bb" (UID: "ce0b88b9-0b20-4041-a3c3-024c63d031bb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:58:42.791733 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791695 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-oauth-serving-cert\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:58:42.791733 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791715 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-config\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:58:42.791937 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.791906 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-service-ca" (OuterVolumeSpecName: "service-ca") pod "ce0b88b9-0b20-4041-a3c3-024c63d031bb" (UID: "ce0b88b9-0b20-4041-a3c3-024c63d031bb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:58:42.793535 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.793511 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce0b88b9-0b20-4041-a3c3-024c63d031bb-kube-api-access-2kg72" (OuterVolumeSpecName: "kube-api-access-2kg72") pod "ce0b88b9-0b20-4041-a3c3-024c63d031bb" (UID: "ce0b88b9-0b20-4041-a3c3-024c63d031bb"). InnerVolumeSpecName "kube-api-access-2kg72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:58:42.793628 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.793605 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ce0b88b9-0b20-4041-a3c3-024c63d031bb" (UID: "ce0b88b9-0b20-4041-a3c3-024c63d031bb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:58:42.891980 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.891951 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-trusted-ca-bundle\") pod \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " Jul 29 16:58:42.892155 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.891989 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-serving-cert\") pod \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\" (UID: \"ce0b88b9-0b20-4041-a3c3-024c63d031bb\") " Jul 29 16:58:42.892262 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.892247 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-service-ca\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:58:42.892320 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.892269 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kg72\" (UniqueName: \"kubernetes.io/projected/ce0b88b9-0b20-4041-a3c3-024c63d031bb-kube-api-access-2kg72\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:58:42.892320 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.892286 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-oauth-config\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:58:42.892320 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.892301 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ce0b88b9-0b20-4041-a3c3-024c63d031bb" (UID: "ce0b88b9-0b20-4041-a3c3-024c63d031bb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:58:42.893882 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.893863 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ce0b88b9-0b20-4041-a3c3-024c63d031bb" (UID: "ce0b88b9-0b20-4041-a3c3-024c63d031bb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:58:42.993459 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.993436 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce0b88b9-0b20-4041-a3c3-024c63d031bb-trusted-ca-bundle\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:58:42.993459 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:42.993457 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ce0b88b9-0b20-4041-a3c3-024c63d031bb-console-serving-cert\") on node \"ip-10-0-132-134.ec2.internal\" DevicePath \"\"" Jul 29 16:58:43.558191 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:43.558158 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce0b88b9-0b20-4041-a3c3-024c63d031bb" containerID="717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6" exitCode=0 Jul 29 16:58:43.558319 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:43.558203 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf68c8bfd-6whdz" Jul 29 16:58:43.558319 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:43.558232 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf68c8bfd-6whdz" event={"ID":"ce0b88b9-0b20-4041-a3c3-024c63d031bb","Type":"ContainerDied","Data":"717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6"} Jul 29 16:58:43.558319 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:43.558274 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf68c8bfd-6whdz" event={"ID":"ce0b88b9-0b20-4041-a3c3-024c63d031bb","Type":"ContainerDied","Data":"807f43c94b1e7c42d5c71f250040817fb30cb6a77190c6c9930507c79fde5893"} Jul 29 16:58:43.558319 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:43.558293 2556 scope.go:117] "RemoveContainer" containerID="717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6" Jul 29 16:58:43.566483 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:43.566468 2556 scope.go:117] "RemoveContainer" containerID="717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6" Jul 29 16:58:43.566706 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:58:43.566689 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6\": container with ID starting with 717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6 not found: ID does not exist" containerID="717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6" Jul 29 16:58:43.566747 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:43.566717 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6"} err="failed to get container status \"717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6\": rpc error: code = NotFound desc = could not find container \"717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6\": container with ID starting with 717d00c0ba79622d358bbb605ec2b9c10e2eafd297eb62312942d820cdffd1d6 not found: ID does not exist" Jul 29 16:58:43.575461 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:43.575439 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf68c8bfd-6whdz"] Jul 29 16:58:43.579668 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:43.579650 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bf68c8bfd-6whdz"] Jul 29 16:58:45.533693 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:45.533655 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce0b88b9-0b20-4041-a3c3-024c63d031bb" path="/var/lib/kubelet/pods/ce0b88b9-0b20-4041-a3c3-024c63d031bb/volumes" Jul 29 16:58:53.528386 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:58:53.528356 2556 scope.go:117] "RemoveContainer" containerID="3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04" Jul 29 16:58:53.528888 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:58:53.528519 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:59:07.529923 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:07.529885 2556 scope.go:117] "RemoveContainer" containerID="3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04" Jul 29 16:59:07.530420 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:59:07.530146 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:59:18.528678 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:18.528646 2556 scope.go:117] "RemoveContainer" containerID="3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04" Jul 29 16:59:18.529165 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:59:18.528862 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:59:31.528724 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:31.528697 2556 scope.go:117] "RemoveContainer" containerID="3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04" Jul 29 16:59:32.774066 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:32.774017 2556 generic.go:356] "Generic (PLEG): container finished" podID="4874ff68-c794-4996-ac3b-36645ce74868" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" exitCode=1 Jul 29 16:59:32.774474 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:32.774089 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerDied","Data":"c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae"} Jul 29 16:59:32.774474 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:32.774148 2556 scope.go:117] "RemoveContainer" containerID="3d1698b774767020326f1c8f9b3d66a3b3de98560c0ca7c640b1f7345efb4a04" Jul 29 16:59:32.774474 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:32.774423 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 16:59:32.774641 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:59:32.774623 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:59:33.534406 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:33.534379 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:59:33.780689 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:33.780659 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 16:59:33.781114 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:59:33.780832 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:59:41.588533 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:41.588500 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 16:59:41.588922 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:41.588843 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 16:59:41.589016 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:59:41.588998 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 16:59:55.528658 ip-10-0-132-134 kubenswrapper[2556]: I0729 16:59:55.528565 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 16:59:55.529275 ip-10-0-132-134 kubenswrapper[2556]: E0729 16:59:55.528763 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:00:09.528859 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:00:09.528828 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 17:00:09.529266 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:00:09.528983 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:00:24.529105 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:00:24.529074 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 17:00:24.529488 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:00:24.529235 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:00:37.530523 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:00:37.530497 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 17:00:37.531006 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:00:37.530706 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:00:51.528794 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:00:51.528762 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 17:00:51.529289 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:00:51.528983 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:00:57.482466 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:00:57.482438 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 17:00:57.484415 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:00:57.484390 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 17:01:03.528895 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:03.528857 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 17:01:11.202824 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:11.202784 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerStarted","Data":"cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376"} Jul 29 17:01:11.203267 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:11.202992 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 17:01:12.208618 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:12.208581 2556 generic.go:356] "Generic (PLEG): container finished" podID="4874ff68-c794-4996-ac3b-36645ce74868" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" exitCode=1 Jul 29 17:01:12.209042 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:12.208673 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerDied","Data":"cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376"} Jul 29 17:01:12.209042 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:12.208725 2556 scope.go:117] "RemoveContainer" containerID="c0ead25ca2c3aeafbd1e213c55324d620f4e2a3fb702c71bb9ce223cb11f34ae" Jul 29 17:01:12.209042 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:12.208869 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:01:12.209194 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:01:12.209101 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:01:13.214263 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:13.214237 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:01:13.214648 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:01:13.214396 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:01:21.588965 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:21.588878 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 17:01:21.589365 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:21.589277 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:01:21.589472 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:01:21.589452 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:01:35.528539 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:35.528506 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:01:35.529026 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:01:35.528681 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:01:47.530364 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:01:47.530338 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:01:47.530844 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:01:47.530516 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:02:00.528267 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:02:00.528236 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:02:00.528656 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:02:00.528419 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:02:14.528194 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:02:14.528163 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:02:14.528583 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:02:14.528332 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:02:26.528826 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:02:26.528797 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:02:26.529307 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:02:26.528960 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:02:41.529069 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:02:41.529019 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:02:41.529526 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:02:41.529297 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:02:54.528596 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:02:54.528512 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:02:54.529148 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:02:54.528698 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:03:06.528207 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:03:06.528174 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:03:06.528677 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:03:06.528351 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:03:17.530830 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:03:17.530803 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:03:17.531408 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:03:17.530984 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:03:32.528453 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:03:32.528424 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:03:32.528847 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:03:32.528638 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:03:45.528507 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:03:45.528476 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:03:45.528992 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:03:45.528656 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:04:00.528185 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:00.528156 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:04:00.528558 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:00.528450 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:04:00.965570 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:00.965541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerStarted","Data":"5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a"} Jul 29 17:04:00.965764 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:00.965748 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 17:04:01.971197 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:01.971167 2556 generic.go:356] "Generic (PLEG): container finished" podID="4874ff68-c794-4996-ac3b-36645ce74868" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" exitCode=1 Jul 29 17:04:01.971634 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:01.971205 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" event={"ID":"4874ff68-c794-4996-ac3b-36645ce74868","Type":"ContainerDied","Data":"5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a"} Jul 29 17:04:01.971634 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:01.971251 2556 scope.go:117] "RemoveContainer" containerID="cf03102192f92690e37096035ac2514f4fefd0b8730cb0ec2c90d91e41d76376" Jul 29 17:04:01.971634 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:01.971411 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:04:01.971757 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:04:01.971645 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:04:02.976385 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:02.976353 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:04:02.976801 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:04:02.976512 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:04:11.588315 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:11.588280 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" Jul 29 17:04:11.588717 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:11.588600 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:04:11.588788 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:04:11.588769 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:04:22.529066 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:22.528963 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:04:22.529534 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:04:22.529175 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:04:33.528639 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:33.528608 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:04:33.529016 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:04:33.528780 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:04:48.528696 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:04:48.528664 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:04:48.529134 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:04:48.528823 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:05:02.528874 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:05:02.528845 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:05:02.529381 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:05:02.529022 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:05:13.528427 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:05:13.528395 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:05:13.528806 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:05:13.528555 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:05:26.528336 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:05:26.528308 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:05:26.528700 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:05:26.528517 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:05:38.528008 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:05:38.527979 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:05:38.528501 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:05:38.528175 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:05:50.528759 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:05:50.528684 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:05:50.529237 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:05:50.528890 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:05:57.509553 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:05:57.509523 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 17:05:57.509959 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:05:57.509741 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 17:06:05.528800 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:06:05.528766 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:06:05.529233 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:06:05.528921 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:06:17.530307 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:06:17.530278 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:06:17.532882 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:06:17.530463 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:06:32.528209 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:06:32.528178 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:06:32.528594 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:06:32.528363 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:06:45.528989 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:06:45.528958 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:06:45.529473 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:06:45.529195 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:06:59.528315 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:06:59.528285 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:06:59.528731 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:06:59.528474 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:07:14.528323 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:07:14.528292 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:07:14.528718 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:07:14.528467 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:07:28.528524 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:07:28.528446 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:07:28.528963 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:07:28.528609 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:07:39.528913 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:07:39.528876 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:07:39.529416 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:07:39.529123 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:07:47.823268 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:07:47.823223 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-h8m4z_4874ff68-c794-4996-ac3b-36645ce74868/manager/6.log" Jul 29 17:07:50.528996 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:07:50.528965 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:07:50.529388 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:07:50.529168 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:08:05.528731 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:05.528703 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:08:05.529187 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:08:05.528864 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:08:13.861458 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:13.861425 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-77lxz_589260e8-5438-419f-b665-7e36b674bb99/global-pull-secret-syncer/0.log" Jul 29 17:08:14.064274 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:14.064228 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kdkxp_287647ea-606f-452e-9f4b-3533dcbdfef3/konnectivity-agent/0.log" Jul 29 17:08:14.084013 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:14.083991 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-134.ec2.internal_51238a16678a7e2ea17ddbdcf5c3bea4/haproxy/0.log" Jul 29 17:08:17.850171 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:17.850143 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3813f88f-7c70-41b4-b6af-3ea6cb68ffb9/alertmanager/0.log" Jul 29 17:08:17.879940 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:17.879908 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3813f88f-7c70-41b4-b6af-3ea6cb68ffb9/config-reloader/0.log" Jul 29 17:08:17.911280 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:17.911255 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3813f88f-7c70-41b4-b6af-3ea6cb68ffb9/kube-rbac-proxy-web/0.log" Jul 29 17:08:17.945929 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:17.945904 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3813f88f-7c70-41b4-b6af-3ea6cb68ffb9/kube-rbac-proxy/0.log" Jul 29 17:08:17.970556 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:17.970529 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3813f88f-7c70-41b4-b6af-3ea6cb68ffb9/kube-rbac-proxy-metric/0.log" Jul 29 17:08:17.995593 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:17.995569 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3813f88f-7c70-41b4-b6af-3ea6cb68ffb9/prom-label-proxy/0.log" Jul 29 17:08:18.018030 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:18.018003 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3813f88f-7c70-41b4-b6af-3ea6cb68ffb9/init-config-reloader/0.log" Jul 29 17:08:18.204280 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:18.204184 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-hqd4k_30394f84-d783-4422-b775-ed627d50074b/monitoring-plugin/0.log" Jul 29 17:08:18.241494 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:18.241470 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hvrt_cb8c4589-57e0-40d3-a29c-0b79881cc97b/node-exporter/0.log" Jul 29 17:08:18.264513 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:18.264494 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hvrt_cb8c4589-57e0-40d3-a29c-0b79881cc97b/kube-rbac-proxy/0.log" Jul 29 17:08:18.285759 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:18.285744 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hvrt_cb8c4589-57e0-40d3-a29c-0b79881cc97b/init-textfile/0.log" Jul 29 17:08:18.905350 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:18.905318 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6ff847dd7f-7cmkz_42e7c8d5-48e0-4e06-973f-1f2b714e540f/telemeter-client/0.log" Jul 29 17:08:18.929770 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:18.929747 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6ff847dd7f-7cmkz_42e7c8d5-48e0-4e06-973f-1f2b714e540f/reload/0.log" Jul 29 17:08:18.952248 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:18.952230 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6ff847dd7f-7cmkz_42e7c8d5-48e0-4e06-973f-1f2b714e540f/kube-rbac-proxy/0.log" Jul 29 17:08:18.987091 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:18.987065 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788dc86f6-zhktt_12b9720e-6ae6-4806-8a7b-eb6a60356406/thanos-query/0.log" Jul 29 17:08:19.008375 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:19.008356 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788dc86f6-zhktt_12b9720e-6ae6-4806-8a7b-eb6a60356406/kube-rbac-proxy-web/0.log" Jul 29 17:08:19.042438 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:19.042415 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788dc86f6-zhktt_12b9720e-6ae6-4806-8a7b-eb6a60356406/kube-rbac-proxy/0.log" Jul 29 17:08:19.066081 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:19.066042 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788dc86f6-zhktt_12b9720e-6ae6-4806-8a7b-eb6a60356406/prom-label-proxy/0.log" Jul 29 17:08:19.095341 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:19.095323 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788dc86f6-zhktt_12b9720e-6ae6-4806-8a7b-eb6a60356406/kube-rbac-proxy-rules/0.log" Jul 29 17:08:19.122494 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:19.122474 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-788dc86f6-zhktt_12b9720e-6ae6-4806-8a7b-eb6a60356406/kube-rbac-proxy-metrics/0.log" Jul 29 17:08:19.528785 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:19.528756 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:08:19.528955 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:08:19.528919 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:08:20.459027 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:20.458992 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-fg92r_0a2e138a-a125-4228-bf87-42e2fc3c8ff3/networking-console-plugin/0.log" Jul 29 17:08:20.977428 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:20.977393 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/2.log" Jul 29 17:08:20.984423 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:20.984393 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-mx49x_d2cf8659-9476-4e48-9e1a-ead4225fe5ed/console-operator/3.log" Jul 29 17:08:21.423273 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:21.423198 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8d5d549b6-ll9md_d0b42ff2-c16d-4918-b513-1dce0441cf56/console/0.log" Jul 29 17:08:21.454989 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:21.454964 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-6lgdg_baf8a83d-3182-43dc-b802-ab1fb3d08abd/download-server/0.log" Jul 29 17:08:22.136539 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.136503 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6"] Jul 29 17:08:22.137030 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.137011 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce0b88b9-0b20-4041-a3c3-024c63d031bb" containerName="console" Jul 29 17:08:22.137151 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.137033 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce0b88b9-0b20-4041-a3c3-024c63d031bb" containerName="console" Jul 29 17:08:22.137213 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.137157 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce0b88b9-0b20-4041-a3c3-024c63d031bb" containerName="console" Jul 29 17:08:22.140212 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.140192 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.142836 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.142816 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksgvw\"/\"openshift-service-ca.crt\"" Jul 29 17:08:22.142912 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.142874 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksgvw\"/\"kube-root-ca.crt\"" Jul 29 17:08:22.143680 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.143664 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ksgvw\"/\"default-dockercfg-wxngx\"" Jul 29 17:08:22.153107 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.150390 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6"] Jul 29 17:08:22.229769 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.229733 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j95xf\" (UniqueName: \"kubernetes.io/projected/bee320c5-d525-4ff2-b940-55a80cdea3b9-kube-api-access-j95xf\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.229930 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.229785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-podres\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.229930 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.229810 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-proc\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.229930 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.229833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-sys\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.229930 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.229852 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-lib-modules\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.330887 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.330847 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-sys\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.331086 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.330894 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-lib-modules\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.331086 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.330951 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j95xf\" (UniqueName: \"kubernetes.io/projected/bee320c5-d525-4ff2-b940-55a80cdea3b9-kube-api-access-j95xf\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.331086 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.330989 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-sys\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.331086 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.331000 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-podres\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.331086 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.331074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-proc\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.331310 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.331121 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-lib-modules\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.331310 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.331133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-podres\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.331310 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.331159 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bee320c5-d525-4ff2-b940-55a80cdea3b9-proc\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.339965 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.339942 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j95xf\" (UniqueName: \"kubernetes.io/projected/bee320c5-d525-4ff2-b940-55a80cdea3b9-kube-api-access-j95xf\") pod \"perf-node-gather-daemonset-gh7h6\" (UID: \"bee320c5-d525-4ff2-b940-55a80cdea3b9\") " pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.456854 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.456772 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:22.584755 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.584730 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6"] Jul 29 17:08:22.587309 ip-10-0-132-134 kubenswrapper[2556]: W0729 17:08:22.587278 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbee320c5_d525_4ff2_b940_55a80cdea3b9.slice/crio-7083dc021358868f0e9bbdb7bcf0c28453bea4cfea1fe3319919a6ed83d2bde1 WatchSource:0}: Error finding container 7083dc021358868f0e9bbdb7bcf0c28453bea4cfea1fe3319919a6ed83d2bde1: Status 404 returned error can't find the container with id 7083dc021358868f0e9bbdb7bcf0c28453bea4cfea1fe3319919a6ed83d2bde1 Jul 29 17:08:22.934350 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.934301 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9w5dd_a7f3887b-6db3-4b15-9874-8403eed85250/dns/0.log" Jul 29 17:08:22.955717 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:22.955689 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9w5dd_a7f3887b-6db3-4b15-9874-8403eed85250/kube-rbac-proxy/0.log" Jul 29 17:08:23.093400 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:23.093368 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" event={"ID":"bee320c5-d525-4ff2-b940-55a80cdea3b9","Type":"ContainerStarted","Data":"8c520b7ec43931846bed32093fd2e630f1068a51829236e8cb60cfed0b668293"} Jul 29 17:08:23.093571 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:23.093423 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" event={"ID":"bee320c5-d525-4ff2-b940-55a80cdea3b9","Type":"ContainerStarted","Data":"7083dc021358868f0e9bbdb7bcf0c28453bea4cfea1fe3319919a6ed83d2bde1"} Jul 29 17:08:23.093571 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:23.093504 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:23.098623 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:23.098595 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ld22h_5617951d-8f28-45a2-a22b-fcd4e7477040/dns-node-resolver/0.log" Jul 29 17:08:23.109972 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:23.109930 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" podStartSLOduration=1.109916934 podStartE2EDuration="1.109916934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:08:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:08:23.107984996 +0000 UTC m=+1046.071057885" watchObservedRunningTime="2026-07-29 17:08:23.109916934 +0000 UTC m=+1046.072989833" Jul 29 17:08:23.606440 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:23.606407 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8n58r_74dc9130-9427-43e2-a44a-ce0c2fd928e6/node-ca/0.log" Jul 29 17:08:24.891082 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:24.891039 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9hcc_d7db8c4c-f98f-4446-be03-ccce318d5563/serve-healthcheck-canary/0.log" Jul 29 17:08:25.349816 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:25.349787 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npw8n_d1b494ea-2606-4cdd-9e9a-e9d692866751/kube-rbac-proxy/0.log" Jul 29 17:08:25.370827 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:25.370803 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npw8n_d1b494ea-2606-4cdd-9e9a-e9d692866751/exporter/0.log" Jul 29 17:08:25.394713 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:25.394692 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-npw8n_d1b494ea-2606-4cdd-9e9a-e9d692866751/extractor/0.log" Jul 29 17:08:27.531531 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:27.531501 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-h8m4z_4874ff68-c794-4996-ac3b-36645ce74868/manager/6.log" Jul 29 17:08:27.531973 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:27.531648 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-h8m4z_4874ff68-c794-4996-ac3b-36645ce74868/manager/6.log" Jul 29 17:08:27.554361 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:27.554339 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-8445dbf85d-mqfgb_cb371505-5671-4593-b71f-6eb685758dbd/seaweedfs/0.log" Jul 29 17:08:29.107259 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:29.107229 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ksgvw/perf-node-gather-daemonset-gh7h6" Jul 29 17:08:31.356463 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:31.356429 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-hhkqs_f45bd424-3f53-4d9c-a97e-a6cc07c5234c/migrator/0.log" Jul 29 17:08:31.378018 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:31.377981 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-hhkqs_f45bd424-3f53-4d9c-a97e-a6cc07c5234c/graceful-termination/0.log" Jul 29 17:08:31.528133 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:31.528104 2556 scope.go:117] "RemoveContainer" containerID="5275e486ec0c292970feb5bd89f4417ed85d37e19390499097a8497f4349128a" Jul 29 17:08:31.528341 ip-10-0-132-134 kubenswrapper[2556]: E0729 17:08:31.528320 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-h8m4z_kserve(4874ff68-c794-4996-ac3b-36645ce74868)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-h8m4z" podUID="4874ff68-c794-4996-ac3b-36645ce74868" Jul 29 17:08:32.694019 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:32.693976 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7wmfd_9997fefa-ee6f-4d92-8702-539daa3b846d/kube-multus/0.log" Jul 29 17:08:33.098685 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:33.098658 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w22hn_3374b880-ecef-4909-b431-070b77a83283/kube-multus-additional-cni-plugins/0.log" Jul 29 17:08:33.139592 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:33.139565 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w22hn_3374b880-ecef-4909-b431-070b77a83283/egress-router-binary-copy/0.log" Jul 29 17:08:33.166838 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:33.166815 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w22hn_3374b880-ecef-4909-b431-070b77a83283/cni-plugins/0.log" Jul 29 17:08:33.206738 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:33.206720 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w22hn_3374b880-ecef-4909-b431-070b77a83283/bond-cni-plugin/0.log" Jul 29 17:08:33.238379 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:33.238355 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w22hn_3374b880-ecef-4909-b431-070b77a83283/routeoverride-cni/0.log" Jul 29 17:08:33.258892 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:33.258871 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w22hn_3374b880-ecef-4909-b431-070b77a83283/whereabouts-cni-bincopy/0.log" Jul 29 17:08:33.280082 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:33.280064 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w22hn_3374b880-ecef-4909-b431-070b77a83283/whereabouts-cni/0.log" Jul 29 17:08:33.448627 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:33.448558 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s29ts_1da775fc-ac1d-4a60-89cc-c18daa86454c/network-metrics-daemon/0.log" Jul 29 17:08:33.472533 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:33.472498 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s29ts_1da775fc-ac1d-4a60-89cc-c18daa86454c/kube-rbac-proxy/0.log" Jul 29 17:08:34.643688 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:34.643658 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9xpq_51575911-62f1-48d9-a23e-35ca1fb96855/ovn-controller/0.log" Jul 29 17:08:34.661233 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:34.661205 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9xpq_51575911-62f1-48d9-a23e-35ca1fb96855/ovn-acl-logging/0.log" Jul 29 17:08:34.686420 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:34.686402 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9xpq_51575911-62f1-48d9-a23e-35ca1fb96855/kube-rbac-proxy-node/0.log" Jul 29 17:08:34.707962 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:34.707944 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9xpq_51575911-62f1-48d9-a23e-35ca1fb96855/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 17:08:34.726092 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:34.726076 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9xpq_51575911-62f1-48d9-a23e-35ca1fb96855/northd/0.log" Jul 29 17:08:34.748155 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:34.748120 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9xpq_51575911-62f1-48d9-a23e-35ca1fb96855/nbdb/0.log" Jul 29 17:08:34.769451 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:34.769433 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9xpq_51575911-62f1-48d9-a23e-35ca1fb96855/sbdb/0.log" Jul 29 17:08:34.823558 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:34.823534 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v9xpq_51575911-62f1-48d9-a23e-35ca1fb96855/ovnkube-controller/0.log" Jul 29 17:08:35.854759 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:35.854726 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dng5h_2df87625-a6b8-4739-876f-a39cc90be9af/network-check-target-container/0.log" Jul 29 17:08:36.917838 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:36.917811 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xlsrv_cdde636e-430e-4801-aa33-53cb1f9d8834/iptables-alerter/0.log" Jul 29 17:08:37.491642 ip-10-0-132-134 kubenswrapper[2556]: I0729 17:08:37.491615 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-4vlzj_79474e7f-abba-4a5d-bdcb-8e1da121782e/tuned/0.log"