Jul 29 22:46:11.740313 ip-10-0-133-152 systemd[1]: Starting Kubernetes Kubelet... Jul 29 22:46:12.143522 ip-10-0-133-152 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 22:46:12.143522 ip-10-0-133-152 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 22:46:12.143522 ip-10-0-133-152 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 22:46:12.143522 ip-10-0-133-152 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 22:46:12.143522 ip-10-0-133-152 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 22:46:12.144537 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.144414 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 22:46:12.148863 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148843 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:12.148863 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148862 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148866 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148870 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148873 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148877 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148880 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148883 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148886 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148889 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148892 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148894 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148897 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148899 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148902 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148905 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148908 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148910 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148913 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148916 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:12.148939 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148918 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148923 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148927 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148929 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148932 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148934 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148937 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148940 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148942 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148945 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148948 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148952 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148956 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148958 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148961 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148963 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148966 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148968 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148971 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:12.149509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148973 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148975 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148978 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148980 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148983 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148985 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148988 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148991 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148993 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148996 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.148998 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149000 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149003 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149030 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149033 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149037 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149039 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149042 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149045 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:12.149967 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149047 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149050 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149052 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149055 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149057 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149060 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149062 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149065 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149067 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149070 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149073 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149075 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149078 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149087 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149090 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149092 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149095 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149097 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149100 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149102 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149104 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:12.150447 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149107 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149110 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149113 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149116 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149118 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149121 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149124 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149127 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149129 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149132 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149134 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149136 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149140 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149144 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149147 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149151 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149154 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149157 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149160 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:12.150936 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149162 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149951 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149958 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149963 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149968 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149973 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149983 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149986 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149989 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149991 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149994 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149997 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.149999 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150001 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150020 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150024 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150028 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150031 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150034 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:12.151443 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150037 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150040 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150043 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150045 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150048 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150051 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150054 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150056 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150059 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150061 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150064 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150066 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150069 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150071 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150074 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150076 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150080 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150083 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150085 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150088 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:12.151920 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150098 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150101 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150104 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150106 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150109 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150111 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150114 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150116 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150119 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150122 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150124 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150128 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150130 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150133 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150135 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150138 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150140 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150143 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150146 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:12.152423 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150148 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150151 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150153 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150155 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150158 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150160 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150163 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150166 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150168 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150172 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150174 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150177 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150179 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150182 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150185 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150188 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150190 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150193 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150195 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150198 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150201 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:12.152884 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150204 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150208 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150211 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150214 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150216 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150219 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150221 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150224 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150226 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150229 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150231 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150234 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150236 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150238 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150241 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150243 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150246 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150248 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150251 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:12.153424 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150253 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150257 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150685 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150691 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150695 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150698 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150704 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150707 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150711 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150713 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150716 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150719 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150721 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150724 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150727 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150730 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150732 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150735 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150738 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150741 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:12.153883 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150743 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150746 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150748 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150751 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150754 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150756 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150759 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150761 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150764 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150766 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150769 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150771 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150773 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150777 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150780 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150783 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150785 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150789 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150794 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:12.154393 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150797 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150800 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150802 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150805 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150807 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150810 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150813 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150815 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150818 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150820 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150823 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150825 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150828 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150830 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150833 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150835 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150837 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150840 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150843 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150845 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:12.154852 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150848 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150851 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150853 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150856 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150858 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150860 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150864 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150866 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150869 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150871 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150874 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150878 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150880 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150884 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150886 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150889 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150891 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150894 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150896 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150899 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:12.155377 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150901 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150904 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150906 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150908 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150911 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150913 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150916 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150918 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150923 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150926 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150929 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150932 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150935 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150938 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150941 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150944 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150946 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150949 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150953 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:12.155893 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150955 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150959 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.150962 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151050 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151058 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151064 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151068 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151072 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151075 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151080 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151084 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151087 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151090 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151094 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151097 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151100 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151103 2578 flags.go:64] FLAG: --cgroup-root="" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151106 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151109 2578 flags.go:64] FLAG: --client-ca-file="" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151112 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151114 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151123 2578 flags.go:64] FLAG: --cluster-domain="" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151125 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 22:46:12.156358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151128 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151131 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151134 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151138 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151140 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151143 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151147 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151150 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151153 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151156 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151159 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151162 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151170 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151174 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151176 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151179 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151182 2578 flags.go:64] FLAG: --enable-server="true" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151187 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151192 2578 flags.go:64] FLAG: --event-burst="100" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151195 2578 flags.go:64] FLAG: --event-qps="50" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151198 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151201 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151203 2578 flags.go:64] FLAG: --eviction-hard="" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151207 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 22:46:12.156895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151210 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151213 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151215 2578 flags.go:64] FLAG: --eviction-soft="" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151219 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151222 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151225 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151227 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151230 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151233 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151236 2578 flags.go:64] FLAG: --feature-gates="" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151240 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151243 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151245 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151248 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151251 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151254 2578 flags.go:64] FLAG: --help="false" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151257 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151261 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151264 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151267 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151270 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151274 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151277 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 22:46:12.157547 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151280 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151283 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151286 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151290 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151292 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151295 2578 flags.go:64] FLAG: --kube-reserved="" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151298 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151301 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151303 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151306 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151309 2578 flags.go:64] FLAG: --lock-file="" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151311 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151314 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151317 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151323 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151326 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151329 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151332 2578 flags.go:64] FLAG: --logging-format="text" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151334 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151338 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151340 2578 flags.go:64] FLAG: --manifest-url="" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151343 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151347 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151350 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151354 2578 flags.go:64] FLAG: --max-pods="110" Jul 29 22:46:12.158170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151357 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151360 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151363 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151366 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151369 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151372 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151375 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151383 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151386 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151389 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151392 2578 flags.go:64] FLAG: --pod-cidr="" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151395 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151401 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151404 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151407 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151410 2578 flags.go:64] FLAG: --port="10250" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151413 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151415 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01e97126af42b9402" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151419 2578 flags.go:64] FLAG: --qos-reserved="" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151421 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151424 2578 flags.go:64] FLAG: --register-node="true" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151427 2578 flags.go:64] FLAG: --register-with-taints="" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151430 2578 flags.go:64] FLAG: --registry-burst="10" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151433 2578 flags.go:64] FLAG: --registry-qps="5" Jul 29 22:46:12.158770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151435 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151438 2578 flags.go:64] FLAG: --reserved-memory="" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151442 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151445 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151448 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151451 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151455 2578 flags.go:64] FLAG: --runonce="false" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151458 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151461 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151464 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151467 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151470 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151473 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151476 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151481 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151484 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151487 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151489 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151492 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151495 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151499 2578 flags.go:64] FLAG: --system-cgroups="" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151502 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151507 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151509 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151512 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 22:46:12.159363 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151517 2578 flags.go:64] FLAG: --tls-min-version="" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151519 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151522 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151525 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151528 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151531 2578 flags.go:64] FLAG: --v="2" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151534 2578 flags.go:64] FLAG: --version="false" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151538 2578 flags.go:64] FLAG: --vmodule="" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151542 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151545 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151664 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151667 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151671 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151676 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151678 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151681 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151683 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151686 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151689 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151692 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151694 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:12.159963 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151698 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151701 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151703 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151706 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151708 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151711 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151713 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151716 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151719 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151721 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151724 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151726 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151728 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151731 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151734 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151736 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151738 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151741 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151743 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151746 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:12.160488 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151748 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151751 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151753 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151756 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151760 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151762 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151765 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151767 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151769 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151774 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151777 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151780 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151784 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151787 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151790 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151793 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151796 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151798 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151801 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:12.161018 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151805 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151809 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151811 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151814 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151816 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151819 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151821 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151824 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151826 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151829 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151831 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151833 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151836 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151839 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151841 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151844 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151846 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151850 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151852 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151855 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:12.161499 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151858 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151860 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151863 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151865 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151868 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151872 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151874 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151877 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151879 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151882 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151884 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151887 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151890 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151892 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151895 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151898 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151901 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151903 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151906 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151910 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:12.161990 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151913 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151915 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151918 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151921 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151923 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151926 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151929 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151931 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.151934 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.151941 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.159035 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.159054 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.159069 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.159079 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 22:46:12.162539 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159136 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159142 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159145 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159148 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159153 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159155 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159159 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159162 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159165 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159169 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159173 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159177 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159180 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159183 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159186 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159188 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159191 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159194 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159196 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:12.162887 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159199 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159201 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159204 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159206 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159209 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159212 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159214 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159217 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159219 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159222 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159225 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159228 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159231 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159233 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159238 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159242 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159245 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159248 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159251 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:12.163403 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159253 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159256 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159259 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159262 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159264 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159267 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159270 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159273 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159275 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159278 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159280 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159283 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159285 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159288 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159290 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159292 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159295 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159297 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159300 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159302 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:12.163979 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159304 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159306 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159310 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159313 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159316 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159319 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159321 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159324 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159326 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159329 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159332 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159334 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159337 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159339 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159341 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159344 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159346 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159349 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159352 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159354 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159357 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:12.164472 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159360 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159362 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159365 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159367 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159370 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159373 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159375 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159378 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159381 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159383 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159386 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159388 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159391 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159395 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159399 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159402 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159405 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159408 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159410 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:12.165066 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159413 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.159418 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159551 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159556 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159559 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159562 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159565 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159567 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159570 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159572 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159575 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159577 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159580 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159583 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159585 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 22:46:12.165530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159588 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159591 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159593 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159596 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159598 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159600 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159603 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159605 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159608 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159610 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159613 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159616 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159618 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159621 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159624 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159627 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159629 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159632 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159634 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159637 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 22:46:12.166019 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159640 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159642 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159644 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159647 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159649 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159652 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159654 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159656 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159659 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159662 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159664 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159670 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159672 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159676 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159679 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159682 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159684 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159686 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159689 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 22:46:12.166530 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159691 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159694 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159696 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159699 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159702 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159704 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159707 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159710 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159712 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159715 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159718 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159720 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159723 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159725 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159727 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159730 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159732 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159734 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159737 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159739 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 22:46:12.167069 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159742 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159744 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159747 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159750 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159752 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159755 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159758 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159760 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159763 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159765 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159767 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159770 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159772 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159775 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159777 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159780 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159782 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159786 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159791 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 22:46:12.167833 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159794 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159797 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159800 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159803 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159806 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159808 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159811 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:12.159814 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.159818 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.159958 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.162184 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.163577 2578 server.go:1019] "Starting client certificate rotation" Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.163701 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 22:46:12.168875 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.163759 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 22:46:12.169260 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.166090 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 22:46:12.170054 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.170034 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 22:46:12.190992 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.190960 2578 log.go:25] "Validated CRI v1 runtime API" Jul 29 22:46:12.193264 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.193245 2578 log.go:25] "Validated CRI v1 image API" Jul 29 22:46:12.194137 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.194121 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 22:46:12.196589 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.196562 2578 fs.go:135] Filesystem UUIDs: map[43f6771d-9597-4cba-b374-5926b17cfa1e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 949226c0-108a-413f-a464-005bc62153a4:/dev/nvme0n1p4] Jul 29 22:46:12.196650 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.196588 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 22:46:12.199795 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.199777 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 22:46:12.201528 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.201418 2578 manager.go:216] Machine: {Timestamp:2026-07-29 22:46:12.200309525 +0000 UTC m=+0.341880977 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098419 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2535b2b980b2f54726573a3eb68212 SystemUUID:ec2535b2-b980-b2f5-4726-573a3eb68212 BootID:e4c3bc22-ed60-42dc-85d7-28530badb550 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:79:c1:fc:37:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:79:c1:fc:37:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:63:be:ec:21:d1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 22:46:12.201528 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.201523 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 22:46:12.201651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.201611 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 22:46:12.202574 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.202551 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 22:46:12.202730 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.202577 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 22:46:12.203829 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.203818 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 22:46:12.203861 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.203833 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 22:46:12.203861 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.203841 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 22:46:12.204480 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.204469 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 22:46:12.205250 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.205239 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 22:46:12.207066 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.207054 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 29 22:46:12.207188 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.207178 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 22:46:12.207230 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.207222 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 29 22:46:12.207273 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.207235 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 22:46:12.207273 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.207254 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 22:46:12.207273 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.207265 2578 kubelet.go:398] "Adding apiserver pod source" Jul 29 22:46:12.207399 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.207275 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 22:46:12.207809 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.207792 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 22:46:12.207809 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.207813 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 22:46:12.210061 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.210043 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 22:46:12.211908 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.211887 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 22:46:12.211956 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.211925 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 22:46:12.213448 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213435 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 22:46:12.213487 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213455 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 22:46:12.213487 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213461 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 22:46:12.213487 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213467 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 22:46:12.213487 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213476 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 22:46:12.213487 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213484 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 22:46:12.213625 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213494 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 22:46:12.213625 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213500 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 22:46:12.213625 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213507 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 22:46:12.213625 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213512 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 22:46:12.213625 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213520 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 22:46:12.213625 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.213537 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 22:46:12.214285 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.214275 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 22:46:12.214316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.214287 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 22:46:12.218463 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.218436 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 22:46:12.218558 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.218476 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 22:46:12.218894 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.218861 2578 server.go:1268] "Started kubelet" Jul 29 22:46:12.218965 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.218936 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 22:46:12.219064 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.219021 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 22:46:12.219123 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.219086 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 22:46:12.219175 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.219160 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 22:46:12.219883 ip-10-0-133-152 systemd[1]: Started Kubernetes Kubelet. Jul 29 22:46:12.220675 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.220660 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 22:46:12.221518 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.221503 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 29 22:46:12.224482 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.224457 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 22:46:12.226653 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.226633 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 22:46:12.226734 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.226654 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 22:46:12.226785 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.226741 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:12.227268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227163 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 22:46:12.227268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227177 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 22:46:12.227268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227184 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 22:46:12.227456 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227300 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 29 22:46:12.227456 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227314 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 29 22:46:12.227456 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.226342 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-152.ec2.internal.18c6e42a34750b16 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-152.ec2.internal,UID:ip-10-0-133-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-152.ec2.internal,},FirstTimestamp:2026-07-29 22:46:12.218825494 +0000 UTC m=+0.360396948,LastTimestamp:2026-07-29 22:46:12.218825494 +0000 UTC m=+0.360396948,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-152.ec2.internal,}" Jul 29 22:46:12.227746 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227704 2578 factory.go:55] Registering systemd factory Jul 29 22:46:12.227746 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227726 2578 factory.go:223] Registration of the systemd container factory successfully Jul 29 22:46:12.227938 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227922 2578 factory.go:153] Registering CRI-O factory Jul 29 22:46:12.228035 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227942 2578 factory.go:223] Registration of the crio container factory successfully Jul 29 22:46:12.228035 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.227990 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 22:46:12.228163 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.228063 2578 factory.go:103] Registering Raw factory Jul 29 22:46:12.228163 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.228078 2578 manager.go:1196] Started watching for new ooms in manager Jul 29 22:46:12.228367 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.228218 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jsplf" Jul 29 22:46:12.228703 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.228687 2578 manager.go:349] Starting recovery of all containers Jul 29 22:46:12.231601 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.231576 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 22:46:12.231719 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.231629 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 22:46:12.236616 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.236588 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jsplf" Jul 29 22:46:12.240570 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.240554 2578 manager.go:354] Recovery completed Jul 29 22:46:12.243332 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.243197 2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 29 22:46:12.246692 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.246678 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:12.250378 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.250361 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:12.250460 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.250392 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:12.250460 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.250405 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:12.251077 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.250932 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 22:46:12.251130 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.251083 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 22:46:12.251130 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.251099 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 29 22:46:12.251221 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.250943 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:12.251896 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.251881 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:12.251967 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.251909 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:12.251967 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.251919 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:12.252555 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.252544 2578 policy_none.go:49] "None policy: Start" Jul 29 22:46:12.252591 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.252560 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 22:46:12.252591 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.252570 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 22:46:12.252853 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.252785 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-152.ec2.internal.18c6e42a36567970 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-152.ec2.internal,UID:ip-10-0-133-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-152.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-152.ec2.internal,},FirstTimestamp:2026-07-29 22:46:12.25037656 +0000 UTC m=+0.391948016,LastTimestamp:2026-07-29 22:46:12.25037656 +0000 UTC m=+0.391948016,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-152.ec2.internal,}" Jul 29 22:46:12.253595 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.253582 2578 policy_none.go:47] "Start" Jul 29 22:46:12.290684 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.290663 2578 manager.go:337] "Starting Device Plugin manager" Jul 29 22:46:12.290792 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.290709 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 22:46:12.290792 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.290720 2578 server.go:87] "Starting device plugin registration server" Jul 29 22:46:12.290998 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.290985 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 22:46:12.291082 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.291002 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 22:46:12.291134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.291113 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 22:46:12.291268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.291242 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 22:46:12.291268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.291256 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 22:46:12.291747 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.291725 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 22:46:12.291818 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.291776 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:12.361431 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.361397 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 22:46:12.362737 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.362721 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 22:46:12.362789 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.362767 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 22:46:12.362822 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.362798 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 22:46:12.362859 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.362843 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 22:46:12.365328 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.365305 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:12.391467 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.391433 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:12.392444 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.392425 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:12.392593 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.392465 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:12.392593 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.392480 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:12.392593 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.392511 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.399858 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.399785 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.399858 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.399811 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-152.ec2.internal\": node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:12.414975 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.414944 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:12.463549 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.463519 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal"] Jul 29 22:46:12.463667 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.463589 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:12.464563 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.464547 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:12.464623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.464580 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:12.464623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.464595 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:12.465825 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.465812 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:12.465929 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.465916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.465965 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.465943 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:12.466611 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.466593 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:12.466699 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.466613 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:12.466699 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.466620 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:12.466699 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.466635 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:12.466788 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.466635 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:12.466788 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.466761 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:12.467762 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.467749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.467815 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.467775 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 22:46:12.468450 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.468432 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientMemory" Jul 29 22:46:12.468510 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.468465 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 22:46:12.468510 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.468476 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeHasSufficientPID" Jul 29 22:46:12.483599 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.483579 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-152.ec2.internal\" not found" node="ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.487609 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.487592 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-152.ec2.internal\" not found" node="ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.515797 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.515760 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:12.529498 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.529471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e106aab0cc175d1dd986fc5afd4673a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal\" (UID: \"e106aab0cc175d1dd986fc5afd4673a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.529498 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.529504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e106aab0cc175d1dd986fc5afd4673a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal\" (UID: \"e106aab0cc175d1dd986fc5afd4673a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.529647 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.529523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8778c0f9386a2f70ab01d5a5201fe28-config\") pod \"kube-apiserver-proxy-ip-10-0-133-152.ec2.internal\" (UID: \"f8778c0f9386a2f70ab01d5a5201fe28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.616562 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.616532 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:12.629872 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.629852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8778c0f9386a2f70ab01d5a5201fe28-config\") pod \"kube-apiserver-proxy-ip-10-0-133-152.ec2.internal\" (UID: \"f8778c0f9386a2f70ab01d5a5201fe28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.629956 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.629880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e106aab0cc175d1dd986fc5afd4673a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal\" (UID: \"e106aab0cc175d1dd986fc5afd4673a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.629956 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.629897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e106aab0cc175d1dd986fc5afd4673a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal\" (UID: \"e106aab0cc175d1dd986fc5afd4673a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.629956 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.629938 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e106aab0cc175d1dd986fc5afd4673a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal\" (UID: \"e106aab0cc175d1dd986fc5afd4673a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.630076 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.629971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f8778c0f9386a2f70ab01d5a5201fe28-config\") pod \"kube-apiserver-proxy-ip-10-0-133-152.ec2.internal\" (UID: \"f8778c0f9386a2f70ab01d5a5201fe28\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.630076 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.629971 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e106aab0cc175d1dd986fc5afd4673a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal\" (UID: \"e106aab0cc175d1dd986fc5afd4673a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.717407 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.717333 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:12.786857 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.786812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.790752 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:12.790572 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal" Jul 29 22:46:12.817743 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.817707 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:12.918287 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:12.918246 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:13.018820 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:13.018746 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:13.119285 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:13.119260 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:13.163803 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.163754 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 22:46:13.164287 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.163945 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 22:46:13.219410 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:13.219372 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-152.ec2.internal\" not found" Jul 29 22:46:13.228554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.228529 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:13.240603 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.240576 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 22:41:12 +0000 UTC" deadline="2028-01-31 21:59:33.170694139 +0000 UTC" Jul 29 22:46:13.240603 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.240600 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13223h13m19.930097103s" Jul 29 22:46:13.327208 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.327181 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal" Jul 29 22:46:13.337649 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.337619 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 22:46:13.339504 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.339482 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" Jul 29 22:46:13.350560 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.350533 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 22:46:13.398561 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:13.398525 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode106aab0cc175d1dd986fc5afd4673a8.slice/crio-f69c6d239abddb21fc747142f28a447d3b68cc9d0426323b6053aec1e27c2cc9 WatchSource:0}: Error finding container f69c6d239abddb21fc747142f28a447d3b68cc9d0426323b6053aec1e27c2cc9: Status 404 returned error can't find the container with id f69c6d239abddb21fc747142f28a447d3b68cc9d0426323b6053aec1e27c2cc9 Jul 29 22:46:13.399402 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:13.399365 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8778c0f9386a2f70ab01d5a5201fe28.slice/crio-d3df8c2d5cbe09f83740b4eb45c35680130910ed72fe8978b79b24aee83780fb WatchSource:0}: Error finding container d3df8c2d5cbe09f83740b4eb45c35680130910ed72fe8978b79b24aee83780fb: Status 404 returned error can't find the container with id d3df8c2d5cbe09f83740b4eb45c35680130910ed72fe8978b79b24aee83780fb Jul 29 22:46:13.404022 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.403990 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 22:46:13.525768 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.525729 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:13.806812 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.806777 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:13.978338 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:13.978304 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 22:46:14.209394 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.209066 2578 apiserver.go:52] "Watching apiserver" Jul 29 22:46:14.217131 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.217071 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 22:46:14.217569 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.217539 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-g4lzk","kube-system/konnectivity-agent-2mpt4","kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal","openshift-dns/node-resolver-bsjll","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal","openshift-multus/multus-6tjmr","openshift-network-diagnostics/network-check-target-spv92","openshift-network-operator/iptables-alerter-dpsdj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6","openshift-cluster-node-tuning-operator/tuned-v5r9p","openshift-image-registry/node-ca-thx5l","openshift-multus/multus-additional-cni-plugins-zfds5","openshift-multus/network-metrics-daemon-82qwh","openshift-ovn-kubernetes/ovnkube-node-nv5w8"] Jul 29 22:46:14.219161 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.219137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:14.219274 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.219230 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:14.220931 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.220363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.221691 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.221665 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.223965 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.222622 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 22:46:14.223965 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.222668 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 22:46:14.223965 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.222959 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nk68m\"" Jul 29 22:46:14.223965 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.223369 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 22:46:14.224262 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.224009 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bbklw\"" Jul 29 22:46:14.224324 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.224311 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 22:46:14.227134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.224467 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 22:46:14.227134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.224499 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 22:46:14.227134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.224996 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 22:46:14.227134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.225096 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 22:46:14.227134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.225302 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 22:46:14.227134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.226271 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.227491 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.227242 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 22:46:14.228898 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.228636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.229944 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.229661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.230346 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.230196 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 22:46:14.230346 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.230225 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 22:46:14.230346 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.230280 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-92zsg\"" Jul 29 22:46:14.231615 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.231587 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.233224 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.233204 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:14.233317 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.233283 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:14.234259 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234229 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:46:14.234357 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234336 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v5bd6\"" Jul 29 22:46:14.234420 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234368 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 22:46:14.234420 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234400 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 22:46:14.234565 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234537 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xbwgh\"" Jul 29 22:46:14.234565 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234561 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b9jnh\"" Jul 29 22:46:14.234682 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234593 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 22:46:14.234682 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234595 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 22:46:14.234781 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234547 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 22:46:14.234834 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234785 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 22:46:14.234984 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.234963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:14.235091 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.235013 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 22:46:14.235166 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.235146 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 22:46:14.235397 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.235378 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 22:46:14.235457 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.235442 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.238618 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.238590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-run-netns\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.238716 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.238643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-run-systemd\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.238775 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.238721 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.238833 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.238795 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:14.240132 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.239946 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-cni-bin\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240229 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-log-socket\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240293 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-cni-netd\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240293 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/873e3bef-3dfb-481c-b0f7-672fb510f13d-ovnkube-config\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240393 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgc4w\" (UniqueName: \"kubernetes.io/projected/62bf8143-aead-46e4-a8f5-9c306902e46d-kube-api-access-bgc4w\") pod \"iptables-alerter-dpsdj\" (UID: \"62bf8143-aead-46e4-a8f5-9c306902e46d\") " pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.240393 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240393 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/873e3bef-3dfb-481c-b0f7-672fb510f13d-env-overrides\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240393 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-run-ovn\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240574 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240400 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-run-ovn-kubernetes\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240574 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/873e3bef-3dfb-481c-b0f7-672fb510f13d-ovn-node-metrics-cert\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240574 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89f03d30-531d-4ea5-855b-e8649825f324-hosts-file\") pod \"node-resolver-bsjll\" (UID: \"89f03d30-531d-4ea5-855b-e8649825f324\") " pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.240574 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240556 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-run-openvswitch\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240753 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-node-log\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240753 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240604 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srl8m\" (UniqueName: \"kubernetes.io/projected/89f03d30-531d-4ea5-855b-e8649825f324-kube-api-access-srl8m\") pod \"node-resolver-bsjll\" (UID: \"89f03d30-531d-4ea5-855b-e8649825f324\") " pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.240753 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62bf8143-aead-46e4-a8f5-9c306902e46d-host-slash\") pod \"iptables-alerter-dpsdj\" (UID: \"62bf8143-aead-46e4-a8f5-9c306902e46d\") " pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.240912 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240770 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:14.240912 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-kubelet\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240912 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-systemd-units\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.240912 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-slash\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.241135 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.240856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/873e3bef-3dfb-481c-b0f7-672fb510f13d-ovnkube-script-lib\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.241135 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.241006 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/441350f3-019d-46d2-a6de-9036c164e19b-host\") pod \"node-ca-thx5l\" (UID: \"441350f3-019d-46d2-a6de-9036c164e19b\") " pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.241135 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.241028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-var-lib-openvswitch\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.241135 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.241058 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-etc-openvswitch\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.241135 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.241103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/62bf8143-aead-46e4-a8f5-9c306902e46d-iptables-alerter-script\") pod \"iptables-alerter-dpsdj\" (UID: \"62bf8143-aead-46e4-a8f5-9c306902e46d\") " pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.241400 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.241370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9tqq\" (UniqueName: \"kubernetes.io/projected/873e3bef-3dfb-481c-b0f7-672fb510f13d-kube-api-access-z9tqq\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.241480 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.241436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89f03d30-531d-4ea5-855b-e8649825f324-tmp-dir\") pod \"node-resolver-bsjll\" (UID: \"89f03d30-531d-4ea5-855b-e8649825f324\") " pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.241729 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.241706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/441350f3-019d-46d2-a6de-9036c164e19b-serviceca\") pod \"node-ca-thx5l\" (UID: \"441350f3-019d-46d2-a6de-9036c164e19b\") " pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.241796 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.241759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whkc5\" (UniqueName: \"kubernetes.io/projected/441350f3-019d-46d2-a6de-9036c164e19b-kube-api-access-whkc5\") pod \"node-ca-thx5l\" (UID: \"441350f3-019d-46d2-a6de-9036c164e19b\") " pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.242489 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.242461 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 22:46:14.242620 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.242595 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:46:14.242696 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.242677 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 22:46:14.243052 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.243029 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ncpf7\"" Jul 29 22:46:14.243152 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.243070 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 22:46:14.243464 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.243444 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b7tsw\"" Jul 29 22:46:14.244287 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.243609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.245709 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.245668 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 22:46:14.245709 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.245682 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 22:46:14.247533 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.247511 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tvz2d\"" Jul 29 22:46:14.248747 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.248568 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 22:46:14.265404 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.265367 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2xw5q" Jul 29 22:46:14.275844 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.275818 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2xw5q" Jul 29 22:46:14.328503 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.328476 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 22:46:14.342825 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.342788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-registration-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.342995 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.342832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4982c15c-9467-4626-8bd8-cbce2f480236-dbus\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.342995 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.342854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw9zv\" (UniqueName: \"kubernetes.io/projected/9f806c44-a965-4aca-b4f7-fa89e1021afa-kube-api-access-xw9zv\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:14.342995 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.342928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-kubelet\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.342995 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.342980 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-slash\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.343237 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/873e3bef-3dfb-481c-b0f7-672fb510f13d-ovnkube-script-lib\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.343237 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-kubelet\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.343237 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfd2q\" (UniqueName: \"kubernetes.io/projected/caa3926b-3b81-472c-bc79-40f5cfcdf844-kube-api-access-hfd2q\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.343237 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.343237 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343129 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-slash\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.343478 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-lib-modules\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.343478 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24636425-6301-4bc4-a368-06cf02bed8e0-tmp\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.343478 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/62bf8143-aead-46e4-a8f5-9c306902e46d-iptables-alerter-script\") pod \"iptables-alerter-dpsdj\" (UID: \"62bf8143-aead-46e4-a8f5-9c306902e46d\") " pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.343478 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.343478 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-socket-dir-parent\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.343735 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-run-multus-certs\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.343735 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-system-cni-dir\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.343735 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-device-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.343735 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q69zk\" (UniqueName: \"kubernetes.io/projected/86dc6cda-7a7e-4518-bbd6-75c31a976df5-kube-api-access-q69zk\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.343735 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343652 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-sysctl-conf\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.343735 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343676 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24636425-6301-4bc4-a368-06cf02bed8e0-etc-tuned\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.343735 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whkc5\" (UniqueName: \"kubernetes.io/projected/441350f3-019d-46d2-a6de-9036c164e19b-kube-api-access-whkc5\") pod \"node-ca-thx5l\" (UID: \"441350f3-019d-46d2-a6de-9036c164e19b\") " pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.343735 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-run-netns\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343758 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-run-netns\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343801 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-systemd\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-run-netns\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-cni-netd\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343899 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/873e3bef-3dfb-481c-b0f7-672fb510f13d-ovnkube-script-lib\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343931 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-cni-netd\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/873e3bef-3dfb-481c-b0f7-672fb510f13d-ovnkube-config\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-var-lib-kubelet\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344009 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-kubernetes\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.343985 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/62bf8143-aead-46e4-a8f5-9c306902e46d-iptables-alerter-script\") pod \"iptables-alerter-dpsdj\" (UID: \"62bf8143-aead-46e4-a8f5-9c306902e46d\") " pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-sysctl-d\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-cnibin\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:14.344159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-host\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/873e3bef-3dfb-481c-b0f7-672fb510f13d-ovn-node-metrics-cert\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-conf-dir\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-socket-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-modprobe-d\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-run\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344326 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srl8m\" (UniqueName: \"kubernetes.io/projected/89f03d30-531d-4ea5-855b-e8649825f324-kube-api-access-srl8m\") pod \"node-resolver-bsjll\" (UID: \"89f03d30-531d-4ea5-855b-e8649825f324\") " pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-cnibin\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344409 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/873e3bef-3dfb-481c-b0f7-672fb510f13d-ovnkube-config\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-systemd-units\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-cni-dir\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caa3926b-3b81-472c-bc79-40f5cfcdf844-cni-binary-copy\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344629 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-systemd-units\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-var-lib-cni-bin\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.344922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344681 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-hostroot\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344685 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-daemon-config\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/441350f3-019d-46d2-a6de-9036c164e19b-host\") pod \"node-ca-thx5l\" (UID: \"441350f3-019d-46d2-a6de-9036c164e19b\") " pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344742 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-var-lib-openvswitch\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344777 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/441350f3-019d-46d2-a6de-9036c164e19b-host\") pod \"node-ca-thx5l\" (UID: \"441350f3-019d-46d2-a6de-9036c164e19b\") " pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-etc-openvswitch\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344809 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-etc-openvswitch\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-run-k8s-cni-cncf-io\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344841 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-var-lib-openvswitch\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9tqq\" (UniqueName: \"kubernetes.io/projected/873e3bef-3dfb-481c-b0f7-672fb510f13d-kube-api-access-z9tqq\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89f03d30-531d-4ea5-855b-e8649825f324-tmp-dir\") pod \"node-resolver-bsjll\" (UID: \"89f03d30-531d-4ea5-855b-e8649825f324\") " pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.344950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bxfh\" (UniqueName: \"kubernetes.io/projected/24636425-6301-4bc4-a368-06cf02bed8e0-kube-api-access-5bxfh\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4982c15c-9467-4626-8bd8-cbce2f480236-kubelet-config\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-os-release\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/441350f3-019d-46d2-a6de-9036c164e19b-serviceca\") pod \"node-ca-thx5l\" (UID: \"441350f3-019d-46d2-a6de-9036c164e19b\") " pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.345786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-run-systemd\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-cni-bin\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345196 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-cni-bin\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345234 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-run-systemd\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345247 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-etc-kubernetes\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-sys-fs\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-log-socket\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgc4w\" (UniqueName: \"kubernetes.io/projected/62bf8143-aead-46e4-a8f5-9c306902e46d-kube-api-access-bgc4w\") pod \"iptables-alerter-dpsdj\" (UID: \"62bf8143-aead-46e4-a8f5-9c306902e46d\") " pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345365 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345378 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-log-socket\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72d39aa6-63d8-41e1-8570-1e1af6e83592-konnectivity-ca\") pod \"konnectivity-agent-2mpt4\" (UID: \"72d39aa6-63d8-41e1-8570-1e1af6e83592\") " pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-sys\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345449 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-var-lib-kubelet\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345484 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89f03d30-531d-4ea5-855b-e8649825f324-tmp-dir\") pod \"node-resolver-bsjll\" (UID: \"89f03d30-531d-4ea5-855b-e8649825f324\") " pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/873e3bef-3dfb-481c-b0f7-672fb510f13d-env-overrides\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.346554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345577 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72d39aa6-63d8-41e1-8570-1e1af6e83592-agent-certs\") pod \"konnectivity-agent-2mpt4\" (UID: \"72d39aa6-63d8-41e1-8570-1e1af6e83592\") " pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345614 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/441350f3-019d-46d2-a6de-9036c164e19b-serviceca\") pod \"node-ca-thx5l\" (UID: \"441350f3-019d-46d2-a6de-9036c164e19b\") " pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-run-ovn\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-run-ovn-kubernetes\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89f03d30-531d-4ea5-855b-e8649825f324-hosts-file\") pod \"node-resolver-bsjll\" (UID: \"89f03d30-531d-4ea5-855b-e8649825f324\") " pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-run-ovn\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345718 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-host-run-ovn-kubernetes\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345733 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89f03d30-531d-4ea5-855b-e8649825f324-hosts-file\") pod \"node-resolver-bsjll\" (UID: \"89f03d30-531d-4ea5-855b-e8649825f324\") " pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-system-cni-dir\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-sysconfig\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-run-openvswitch\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-node-log\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345880 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62bf8143-aead-46e4-a8f5-9c306902e46d-host-slash\") pod \"iptables-alerter-dpsdj\" (UID: \"62bf8143-aead-46e4-a8f5-9c306902e46d\") " pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345921 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62bf8143-aead-46e4-a8f5-9c306902e46d-host-slash\") pod \"iptables-alerter-dpsdj\" (UID: \"62bf8143-aead-46e4-a8f5-9c306902e46d\") " pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-node-log\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345966 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/873e3bef-3dfb-481c-b0f7-672fb510f13d-run-openvswitch\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.345968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-os-release\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.347165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.346033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-var-lib-cni-multus\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.347763 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.346064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4hjh\" (UniqueName: \"kubernetes.io/projected/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-kube-api-access-m4hjh\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.347763 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.346144 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/873e3bef-3dfb-481c-b0f7-672fb510f13d-env-overrides\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.349184 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.349074 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/873e3bef-3dfb-481c-b0f7-672fb510f13d-ovn-node-metrics-cert\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.353846 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.353334 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:14.353846 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.353498 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:14.353846 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.353514 2578 projected.go:196] Error preparing data for projected volume kube-api-access-d5bhl for pod openshift-network-diagnostics/network-check-target-spv92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:14.353846 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.353591 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl podName:c429e361-e445-4d70-9d32-de7413457368 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:14.853561306 +0000 UTC m=+2.995132749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d5bhl" (UniqueName: "kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl") pod "network-check-target-spv92" (UID: "c429e361-e445-4d70-9d32-de7413457368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:14.355187 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.355048 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srl8m\" (UniqueName: \"kubernetes.io/projected/89f03d30-531d-4ea5-855b-e8649825f324-kube-api-access-srl8m\") pod \"node-resolver-bsjll\" (UID: \"89f03d30-531d-4ea5-855b-e8649825f324\") " pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.355757 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.355719 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whkc5\" (UniqueName: \"kubernetes.io/projected/441350f3-019d-46d2-a6de-9036c164e19b-kube-api-access-whkc5\") pod \"node-ca-thx5l\" (UID: \"441350f3-019d-46d2-a6de-9036c164e19b\") " pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.358185 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.357933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgc4w\" (UniqueName: \"kubernetes.io/projected/62bf8143-aead-46e4-a8f5-9c306902e46d-kube-api-access-bgc4w\") pod \"iptables-alerter-dpsdj\" (UID: \"62bf8143-aead-46e4-a8f5-9c306902e46d\") " pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.359079 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.359055 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9tqq\" (UniqueName: \"kubernetes.io/projected/873e3bef-3dfb-481c-b0f7-672fb510f13d-kube-api-access-z9tqq\") pod \"ovnkube-node-nv5w8\" (UID: \"873e3bef-3dfb-481c-b0f7-672fb510f13d\") " pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.370297 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.370235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal" event={"ID":"f8778c0f9386a2f70ab01d5a5201fe28","Type":"ContainerStarted","Data":"d3df8c2d5cbe09f83740b4eb45c35680130910ed72fe8978b79b24aee83780fb"} Jul 29 22:46:14.373600 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.372426 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" event={"ID":"e106aab0cc175d1dd986fc5afd4673a8","Type":"ContainerStarted","Data":"f69c6d239abddb21fc747142f28a447d3b68cc9d0426323b6053aec1e27c2cc9"} Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-sysconfig\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-os-release\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-var-lib-cni-multus\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4hjh\" (UniqueName: \"kubernetes.io/projected/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-kube-api-access-m4hjh\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-registration-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4982c15c-9467-4626-8bd8-cbce2f480236-dbus\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446694 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-sysconfig\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw9zv\" (UniqueName: \"kubernetes.io/projected/9f806c44-a965-4aca-b4f7-fa89e1021afa-kube-api-access-xw9zv\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfd2q\" (UniqueName: \"kubernetes.io/projected/caa3926b-3b81-472c-bc79-40f5cfcdf844-kube-api-access-hfd2q\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-lib-modules\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24636425-6301-4bc4-a368-06cf02bed8e0-tmp\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446894 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-socket-dir-parent\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446919 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-run-multus-certs\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-system-cni-dir\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.448316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.446968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-device-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q69zk\" (UniqueName: \"kubernetes.io/projected/86dc6cda-7a7e-4518-bbd6-75c31a976df5-kube-api-access-q69zk\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447028 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-sysctl-conf\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447051 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24636425-6301-4bc4-a368-06cf02bed8e0-etc-tuned\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-run-netns\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-systemd\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-var-lib-kubelet\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447181 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-kubernetes\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-sysctl-d\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-cnibin\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447303 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-host\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447310 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-os-release\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-conf-dir\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-socket-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447365 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-var-lib-cni-multus\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.451651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-modprobe-d\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-run\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447538 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-run\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-cnibin\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447716 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-cni-dir\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caa3926b-3b81-472c-bc79-40f5cfcdf844-cni-binary-copy\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-var-lib-cni-bin\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-hostroot\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447840 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-daemon-config\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447871 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-lib-modules\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-cnibin\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.447959 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.448019 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret podName:4982c15c-9467-4626-8bd8-cbce2f480236 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:14.948001089 +0000 UTC m=+3.089572536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret") pod "global-pull-secret-syncer-g4lzk" (UID: "4982c15c-9467-4626-8bd8-cbce2f480236") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.448326 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-cni-dir\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.452553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.448902 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caa3926b-3b81-472c-bc79-40f5cfcdf844-cni-binary-copy\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.448964 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-var-lib-cni-bin\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449027 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-hostroot\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449042 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-kubernetes\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449416 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-sysctl-d\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-cnibin\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449519 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-daemon-config\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.449568 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.449615 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs podName:9f806c44-a965-4aca-b4f7-fa89e1021afa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:14.949598191 +0000 UTC m=+3.091169648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs") pod "network-metrics-daemon-82qwh" (UID: "9f806c44-a965-4aca-b4f7-fa89e1021afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449671 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-conf-dir\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449712 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-sysctl-conf\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449722 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-host\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449782 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-multus-socket-dir-parent\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449831 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-run-multus-certs\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449835 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-socket-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449876 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-system-cni-dir\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.453396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449895 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-device-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.449953 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-systemd\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450000 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-run-netns\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450069 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-var-lib-kubelet\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-registration-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450221 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450306 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-etc-modprobe-d\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.447872 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-run-k8s-cni-cncf-io\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bxfh\" (UniqueName: \"kubernetes.io/projected/24636425-6301-4bc4-a368-06cf02bed8e0-kube-api-access-5bxfh\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4982c15c-9467-4626-8bd8-cbce2f480236-kubelet-config\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-os-release\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450410 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-host-run-k8s-cni-cncf-io\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-etc-kubernetes\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450440 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-etc-kubernetes\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-sys-fs\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.454011 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450532 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4982c15c-9467-4626-8bd8-cbce2f480236-dbus\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72d39aa6-63d8-41e1-8570-1e1af6e83592-konnectivity-ca\") pod \"konnectivity-agent-2mpt4\" (UID: \"72d39aa6-63d8-41e1-8570-1e1af6e83592\") " pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-sys\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450581 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-var-lib-kubelet\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72d39aa6-63d8-41e1-8570-1e1af6e83592-agent-certs\") pod \"konnectivity-agent-2mpt4\" (UID: \"72d39aa6-63d8-41e1-8570-1e1af6e83592\") " pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450650 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4982c15c-9467-4626-8bd8-cbce2f480236-kubelet-config\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-system-cni-dir\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450739 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caa3926b-3b81-472c-bc79-40f5cfcdf844-system-cni-dir\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450796 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-os-release\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-sys\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450889 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/24636425-6301-4bc4-a368-06cf02bed8e0-var-lib-kubelet\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450941 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-sys-fs\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.450984 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86dc6cda-7a7e-4518-bbd6-75c31a976df5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.451320 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-cni-binary-copy\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.451661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/72d39aa6-63d8-41e1-8570-1e1af6e83592-konnectivity-ca\") pod \"konnectivity-agent-2mpt4\" (UID: \"72d39aa6-63d8-41e1-8570-1e1af6e83592\") " pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.453201 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/24636425-6301-4bc4-a368-06cf02bed8e0-etc-tuned\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.453598 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24636425-6301-4bc4-a368-06cf02bed8e0-tmp\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.454773 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.453656 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/72d39aa6-63d8-41e1-8570-1e1af6e83592-agent-certs\") pod \"konnectivity-agent-2mpt4\" (UID: \"72d39aa6-63d8-41e1-8570-1e1af6e83592\") " pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:14.466154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.461522 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw9zv\" (UniqueName: \"kubernetes.io/projected/9f806c44-a965-4aca-b4f7-fa89e1021afa-kube-api-access-xw9zv\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:14.466154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.462617 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfd2q\" (UniqueName: \"kubernetes.io/projected/caa3926b-3b81-472c-bc79-40f5cfcdf844-kube-api-access-hfd2q\") pod \"multus-6tjmr\" (UID: \"caa3926b-3b81-472c-bc79-40f5cfcdf844\") " pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.466154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.464517 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4hjh\" (UniqueName: \"kubernetes.io/projected/134368eb-a0bc-4dbc-aac9-8f6c4831bccd-kube-api-access-m4hjh\") pod \"multus-additional-cni-plugins-zfds5\" (UID: \"134368eb-a0bc-4dbc-aac9-8f6c4831bccd\") " pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.466154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.464527 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q69zk\" (UniqueName: \"kubernetes.io/projected/86dc6cda-7a7e-4518-bbd6-75c31a976df5-kube-api-access-q69zk\") pod \"aws-ebs-csi-driver-node-kh8l6\" (UID: \"86dc6cda-7a7e-4518-bbd6-75c31a976df5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.466154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.466001 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bxfh\" (UniqueName: \"kubernetes.io/projected/24636425-6301-4bc4-a368-06cf02bed8e0-kube-api-access-5bxfh\") pod \"tuned-v5r9p\" (UID: \"24636425-6301-4bc4-a368-06cf02bed8e0\") " pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.544238 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.544186 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-thx5l" Jul 29 22:46:14.553794 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.553758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:14.564536 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.564507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bsjll" Jul 29 22:46:14.575504 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.575474 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpsdj" Jul 29 22:46:14.583421 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.583396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6tjmr" Jul 29 22:46:14.598267 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.598228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" Jul 29 22:46:14.607318 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.607292 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:14.619377 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.619155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" Jul 29 22:46:14.624160 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.624137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zfds5" Jul 29 22:46:14.854192 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.854097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:14.854347 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.854298 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:14.854347 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.854324 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:14.854347 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.854339 2578 projected.go:196] Error preparing data for projected volume kube-api-access-d5bhl for pod openshift-network-diagnostics/network-check-target-spv92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:14.854499 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.854406 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl podName:c429e361-e445-4d70-9d32-de7413457368 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:15.854385857 +0000 UTC m=+3.995957314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5bhl" (UniqueName: "kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl") pod "network-check-target-spv92" (UID: "c429e361-e445-4d70-9d32-de7413457368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:14.955372 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.955325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:14.955573 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:14.955388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:14.955573 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.955500 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:14.955573 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.955557 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:14.955746 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.955576 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs podName:9f806c44-a965-4aca-b4f7-fa89e1021afa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:15.955554869 +0000 UTC m=+4.097126310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs") pod "network-metrics-daemon-82qwh" (UID: "9f806c44-a965-4aca-b4f7-fa89e1021afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:14.955746 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:14.955624 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret podName:4982c15c-9467-4626-8bd8-cbce2f480236 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:15.955607138 +0000 UTC m=+4.097178582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret") pod "global-pull-secret-syncer-g4lzk" (UID: "4982c15c-9467-4626-8bd8-cbce2f480236") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:15.278570 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:15.278525 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 22:41:14 +0000 UTC" deadline="2028-01-26 12:14:45.653269179 +0000 UTC" Jul 29 22:46:15.278570 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:15.278566 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13093h28m30.374707635s" Jul 29 22:46:15.363753 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:15.363724 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:15.363910 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:15.363862 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:15.377948 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:15.377926 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86dc6cda_7a7e_4518_bbd6_75c31a976df5.slice/crio-efcf94996d1360901d8d54ee7d5a8702ad5e875a857f7026f9528ec3b460f4b1 WatchSource:0}: Error finding container efcf94996d1360901d8d54ee7d5a8702ad5e875a857f7026f9528ec3b460f4b1: Status 404 returned error can't find the container with id efcf94996d1360901d8d54ee7d5a8702ad5e875a857f7026f9528ec3b460f4b1 Jul 29 22:46:15.392588 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:15.392558 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134368eb_a0bc_4dbc_aac9_8f6c4831bccd.slice/crio-df0ccc66222fb1d9c13fad36d2698d99f5069bd4a6f178802435f39e3d20789f WatchSource:0}: Error finding container df0ccc66222fb1d9c13fad36d2698d99f5069bd4a6f178802435f39e3d20789f: Status 404 returned error can't find the container with id df0ccc66222fb1d9c13fad36d2698d99f5069bd4a6f178802435f39e3d20789f Jul 29 22:46:15.863702 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:15.863436 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:15.863702 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:15.863636 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:15.863702 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:15.863661 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:15.863702 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:15.863674 2578 projected.go:196] Error preparing data for projected volume kube-api-access-d5bhl for pod openshift-network-diagnostics/network-check-target-spv92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:15.863964 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:15.863737 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl podName:c429e361-e445-4d70-9d32-de7413457368 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:17.863722248 +0000 UTC m=+6.005293690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5bhl" (UniqueName: "kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl") pod "network-check-target-spv92" (UID: "c429e361-e445-4d70-9d32-de7413457368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:15.964339 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:15.964306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:15.964339 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:15.964351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:15.964596 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:15.964482 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:15.964596 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:15.964546 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret podName:4982c15c-9467-4626-8bd8-cbce2f480236 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:17.964527619 +0000 UTC m=+6.106099077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret") pod "global-pull-secret-syncer-g4lzk" (UID: "4982c15c-9467-4626-8bd8-cbce2f480236") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:15.964957 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:15.964856 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:15.964957 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:15.964935 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs podName:9f806c44-a965-4aca-b4f7-fa89e1021afa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:17.964916373 +0000 UTC m=+6.106487829 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs") pod "network-metrics-daemon-82qwh" (UID: "9f806c44-a965-4aca-b4f7-fa89e1021afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:16.279876 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.279779 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 22:41:14 +0000 UTC" deadline="2028-01-05 23:28:49.728417462 +0000 UTC" Jul 29 22:46:16.279876 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.279843 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12600h42m33.448578953s" Jul 29 22:46:16.364479 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.364240 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:16.364479 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:16.364403 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:16.366235 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.366213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:16.366406 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:16.366381 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:16.384359 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.383605 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal" event={"ID":"f8778c0f9386a2f70ab01d5a5201fe28","Type":"ContainerStarted","Data":"292e57129d5395c6178109546411221eab197440f628ca62a4201bf11c851237"} Jul 29 22:46:16.390255 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.390190 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mpt4" event={"ID":"72d39aa6-63d8-41e1-8570-1e1af6e83592","Type":"ContainerStarted","Data":"e161257f7fa5d4769e91ab12ea1f90a5a626f4b4ccb0980d79925f1d4ba9e160"} Jul 29 22:46:16.396385 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.396315 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" event={"ID":"24636425-6301-4bc4-a368-06cf02bed8e0","Type":"ContainerStarted","Data":"ad0f54999e251e1a4edf8587133d46212d4e03b537e0f07ff49888f26af69770"} Jul 29 22:46:16.409315 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.409218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bsjll" event={"ID":"89f03d30-531d-4ea5-855b-e8649825f324","Type":"ContainerStarted","Data":"74100c6cffd762212acd480f8e887614b1f5e297f7a7e239a04e37f3d189eeff"} Jul 29 22:46:16.414104 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.413946 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfds5" event={"ID":"134368eb-a0bc-4dbc-aac9-8f6c4831bccd","Type":"ContainerStarted","Data":"df0ccc66222fb1d9c13fad36d2698d99f5069bd4a6f178802435f39e3d20789f"} Jul 29 22:46:16.419781 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.419744 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" event={"ID":"86dc6cda-7a7e-4518-bbd6-75c31a976df5","Type":"ContainerStarted","Data":"efcf94996d1360901d8d54ee7d5a8702ad5e875a857f7026f9528ec3b460f4b1"} Jul 29 22:46:16.429210 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.428868 2578 generic.go:356] "Generic (PLEG): container finished" podID="e106aab0cc175d1dd986fc5afd4673a8" containerID="22372a1259480e7eb40a14657482bf5b07ae914b717aa6399116b78cacd83688" exitCode=0 Jul 29 22:46:16.429210 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.429138 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" event={"ID":"e106aab0cc175d1dd986fc5afd4673a8","Type":"ContainerDied","Data":"22372a1259480e7eb40a14657482bf5b07ae914b717aa6399116b78cacd83688"} Jul 29 22:46:16.434600 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.434566 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" event={"ID":"873e3bef-3dfb-481c-b0f7-672fb510f13d","Type":"ContainerStarted","Data":"a49d33dcb92fd58133ff5c79076e5a94bddd915184facef04bb2c9ec57061f72"} Jul 29 22:46:16.438029 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.437935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-thx5l" event={"ID":"441350f3-019d-46d2-a6de-9036c164e19b","Type":"ContainerStarted","Data":"ee9b7371bca546c86f3e2cd3152b9b28de01796e679ab767a3aae39c3bb8b9d9"} Jul 29 22:46:16.447480 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.446537 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-152.ec2.internal" podStartSLOduration=3.446522586 podStartE2EDuration="3.446522586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:16.404510237 +0000 UTC m=+4.546081704" watchObservedRunningTime="2026-07-29 22:46:16.446522586 +0000 UTC m=+4.588094048" Jul 29 22:46:16.454523 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.454494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpsdj" event={"ID":"62bf8143-aead-46e4-a8f5-9c306902e46d","Type":"ContainerStarted","Data":"65cd633d9f6b4aeeb08d89d18d79cbb78a4ab66558965e853fef644d3963891b"} Jul 29 22:46:16.472827 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:16.472780 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6tjmr" event={"ID":"caa3926b-3b81-472c-bc79-40f5cfcdf844","Type":"ContainerStarted","Data":"e4633302084d77f0247c67f016550ad51061fc7a5ecee446eca707108a102d30"} Jul 29 22:46:17.364194 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:17.363669 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:17.364194 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:17.363814 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:17.488288 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:17.488247 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" event={"ID":"e106aab0cc175d1dd986fc5afd4673a8","Type":"ContainerStarted","Data":"2ffafa7ca8671ce7bc740a10b02a54b55ca94733562365d37f821594b7dcdc45"} Jul 29 22:46:17.506478 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:17.506316 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-152.ec2.internal" podStartSLOduration=4.506296015 podStartE2EDuration="4.506296015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:17.505519013 +0000 UTC m=+5.647090475" watchObservedRunningTime="2026-07-29 22:46:17.506296015 +0000 UTC m=+5.647867479" Jul 29 22:46:17.891591 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:17.891551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:17.891780 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:17.891749 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:17.891780 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:17.891778 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:17.891893 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:17.891792 2578 projected.go:196] Error preparing data for projected volume kube-api-access-d5bhl for pod openshift-network-diagnostics/network-check-target-spv92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:17.891893 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:17.891854 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl podName:c429e361-e445-4d70-9d32-de7413457368 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:21.891836029 +0000 UTC m=+10.033407472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5bhl" (UniqueName: "kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl") pod "network-check-target-spv92" (UID: "c429e361-e445-4d70-9d32-de7413457368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:17.993026 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:17.992965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:17.993212 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:17.993040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:17.993212 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:17.993203 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:17.993321 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:17.993264 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret podName:4982c15c-9467-4626-8bd8-cbce2f480236 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:21.993246406 +0000 UTC m=+10.134817852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret") pod "global-pull-secret-syncer-g4lzk" (UID: "4982c15c-9467-4626-8bd8-cbce2f480236") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:17.993384 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:17.993326 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:17.993384 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:17.993360 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs podName:9f806c44-a965-4aca-b4f7-fa89e1021afa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:21.993347735 +0000 UTC m=+10.134919178 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs") pod "network-metrics-daemon-82qwh" (UID: "9f806c44-a965-4aca-b4f7-fa89e1021afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:18.366364 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:18.366275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:18.366799 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:18.366414 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:18.366872 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:18.366814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:18.366921 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:18.366902 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:19.363599 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:19.363529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:19.363823 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:19.363663 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:20.363802 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:20.363772 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:20.364265 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:20.363908 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:20.364265 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:20.363771 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:20.364368 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:20.364285 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:21.363984 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:21.363890 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:21.364409 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:21.364088 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:21.929633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:21.929592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:21.929815 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:21.929786 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:21.929815 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:21.929812 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:21.929937 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:21.929826 2578 projected.go:196] Error preparing data for projected volume kube-api-access-d5bhl for pod openshift-network-diagnostics/network-check-target-spv92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:21.929937 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:21.929896 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl podName:c429e361-e445-4d70-9d32-de7413457368 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:29.929878146 +0000 UTC m=+18.071449590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5bhl" (UniqueName: "kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl") pod "network-check-target-spv92" (UID: "c429e361-e445-4d70-9d32-de7413457368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:22.030297 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:22.030257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:22.030480 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:22.030311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:22.030480 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:22.030435 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:22.030480 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:22.030436 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:22.030643 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:22.030497 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret podName:4982c15c-9467-4626-8bd8-cbce2f480236 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:30.030480234 +0000 UTC m=+18.172051676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret") pod "global-pull-secret-syncer-g4lzk" (UID: "4982c15c-9467-4626-8bd8-cbce2f480236") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:22.030643 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:22.030516 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs podName:9f806c44-a965-4aca-b4f7-fa89e1021afa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:30.030506305 +0000 UTC m=+18.172077747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs") pod "network-metrics-daemon-82qwh" (UID: "9f806c44-a965-4aca-b4f7-fa89e1021afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:22.367567 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:22.367486 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:22.368037 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:22.367611 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:22.368037 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:22.367995 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:22.368147 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:22.368106 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:23.363021 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:23.362970 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:23.363211 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:23.363096 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:24.363900 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:24.363812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:24.364376 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:24.363946 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:24.365367 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:24.365334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:24.365501 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:24.365461 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:25.363392 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:25.363359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:25.363590 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:25.363484 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:26.363038 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:26.362999 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:26.363419 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:26.363062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:26.363419 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:26.363165 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:26.363419 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:26.363266 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:27.363415 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:27.363384 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:27.363870 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:27.363506 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:28.364028 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:28.363973 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:28.364502 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:28.364044 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:28.364502 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:28.364123 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:28.364502 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:28.364247 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:29.363489 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:29.363449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:29.363710 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:29.363568 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:29.992489 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:29.992445 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:29.993055 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:29.992585 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:29.993055 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:29.992599 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:29.993055 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:29.992608 2578 projected.go:196] Error preparing data for projected volume kube-api-access-d5bhl for pod openshift-network-diagnostics/network-check-target-spv92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:29.993055 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:29.992668 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl podName:c429e361-e445-4d70-9d32-de7413457368 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:45.992650516 +0000 UTC m=+34.134221961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5bhl" (UniqueName: "kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl") pod "network-check-target-spv92" (UID: "c429e361-e445-4d70-9d32-de7413457368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:30.093196 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:30.093166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:30.093389 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:30.093209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:30.093389 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:30.093311 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:30.093389 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:30.093336 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:30.093389 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:30.093368 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs podName:9f806c44-a965-4aca-b4f7-fa89e1021afa nodeName:}" failed. No retries permitted until 2026-07-29 22:46:46.093352599 +0000 UTC m=+34.234924038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs") pod "network-metrics-daemon-82qwh" (UID: "9f806c44-a965-4aca-b4f7-fa89e1021afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:30.093389 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:30.093388 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret podName:4982c15c-9467-4626-8bd8-cbce2f480236 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:46.093375868 +0000 UTC m=+34.234947311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret") pod "global-pull-secret-syncer-g4lzk" (UID: "4982c15c-9467-4626-8bd8-cbce2f480236") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:30.363264 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:30.363179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:30.363398 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:30.363312 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:30.363398 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:30.363371 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:30.363500 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:30.363481 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:31.363940 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:31.363905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:31.364403 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:31.364055 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:32.365049 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:32.364747 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:32.365049 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:32.364866 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:32.365049 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:32.364927 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:32.365581 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:32.365084 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:33.363188 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:33.363156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:33.363361 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:33.363259 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:34.374512 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.373622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:34.374512 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:34.373927 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:34.374512 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.374364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:34.374512 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:34.374471 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:34.524561 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.524318 2578 generic.go:356] "Generic (PLEG): container finished" podID="134368eb-a0bc-4dbc-aac9-8f6c4831bccd" containerID="a6b61f661220f793f0dbcd0fc99f6aa8fd967bcc9cf7bbc5ff0ec348c3b9c0fd" exitCode=0 Jul 29 22:46:34.524678 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.524416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfds5" event={"ID":"134368eb-a0bc-4dbc-aac9-8f6c4831bccd","Type":"ContainerDied","Data":"a6b61f661220f793f0dbcd0fc99f6aa8fd967bcc9cf7bbc5ff0ec348c3b9c0fd"} Jul 29 22:46:34.526228 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.526201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" event={"ID":"86dc6cda-7a7e-4518-bbd6-75c31a976df5","Type":"ContainerStarted","Data":"a4b0d61b5a56d3a0715bb6f2180bc6af5d53df8e538fa33ebe0dc14779438742"} Jul 29 22:46:34.528000 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.527976 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" event={"ID":"873e3bef-3dfb-481c-b0f7-672fb510f13d","Type":"ContainerStarted","Data":"002a232ad7a883e4d752dbab281006bc8a02c86bfbe1ef380a7dbd97235756b3"} Jul 29 22:46:34.529564 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.529525 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-thx5l" event={"ID":"441350f3-019d-46d2-a6de-9036c164e19b","Type":"ContainerStarted","Data":"578f50c698d116cfaf4bf132eb0091a3a331df1e9ff6d2dbfa42f4aee8c0e38e"} Jul 29 22:46:34.531563 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.531539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6tjmr" event={"ID":"caa3926b-3b81-472c-bc79-40f5cfcdf844","Type":"ContainerStarted","Data":"2312099b654bfac2d054303bf250ed106a66dab28637cfc7709cd5f17fc93af1"} Jul 29 22:46:34.533794 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.533771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mpt4" event={"ID":"72d39aa6-63d8-41e1-8570-1e1af6e83592","Type":"ContainerStarted","Data":"5a0db43fff321dcdd7bec85310926ad0f93606f2c626d8817b8b6487ba360fa3"} Jul 29 22:46:34.535950 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.535926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" event={"ID":"24636425-6301-4bc4-a368-06cf02bed8e0","Type":"ContainerStarted","Data":"b43af70388be9bed845bb20a50101c9b50ab9b6552e8f38a9ba254ee71770bf9"} Jul 29 22:46:34.537858 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.537831 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bsjll" event={"ID":"89f03d30-531d-4ea5-855b-e8649825f324","Type":"ContainerStarted","Data":"6565bcb6c4aef1b51334d503f6b91761a96c6df133aa46d58cf9624ec98675b1"} Jul 29 22:46:34.567040 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.566969 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-thx5l" podStartSLOduration=7.896142051 podStartE2EDuration="22.566953217s" totalImagesPullingTime="14.670811166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:34.566586559 +0000 UTC m=+22.708158024" watchObservedRunningTime="2026-07-29 22:46:34.566953217 +0000 UTC m=+22.708524681" Jul 29 22:46:34.585449 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.585396 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v5r9p" podStartSLOduration=3.736803915 podStartE2EDuration="22.585377055s" totalImagesPullingTime="18.84857314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:34.584581773 +0000 UTC m=+22.726153236" watchObservedRunningTime="2026-07-29 22:46:34.585377055 +0000 UTC m=+22.726948519" Jul 29 22:46:34.602397 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.602352 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bsjll" podStartSLOduration=3.755565367 podStartE2EDuration="22.602337013s" totalImagesPullingTime="18.846771646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:34.602190478 +0000 UTC m=+22.743761951" watchObservedRunningTime="2026-07-29 22:46:34.602337013 +0000 UTC m=+22.743908474" Jul 29 22:46:34.620538 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.620487 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6tjmr" podStartSLOduration=3.690991123 podStartE2EDuration="22.620470203s" totalImagesPullingTime="18.92947908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:34.620270168 +0000 UTC m=+22.761841630" watchObservedRunningTime="2026-07-29 22:46:34.620470203 +0000 UTC m=+22.762041664" Jul 29 22:46:34.634879 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:34.634830 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2mpt4" podStartSLOduration=3.788882964 podStartE2EDuration="22.634814203s" totalImagesPullingTime="18.845931239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:34.634786056 +0000 UTC m=+22.776357518" watchObservedRunningTime="2026-07-29 22:46:34.634814203 +0000 UTC m=+22.776385665" Jul 29 22:46:35.363654 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.363610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:35.363885 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:35.363735 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:35.543895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.543855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" event={"ID":"873e3bef-3dfb-481c-b0f7-672fb510f13d","Type":"ContainerStarted","Data":"9f12097be0c76bcaa40f44c1569d8082c357133c9f141012bd163ae9cad64341"} Jul 29 22:46:35.544772 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.543952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" event={"ID":"873e3bef-3dfb-481c-b0f7-672fb510f13d","Type":"ContainerStarted","Data":"374007f5dd7b8e19298aa6909568f7d418d1e27163231ece312c3355c0aaa10a"} Jul 29 22:46:35.544772 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.544049 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" event={"ID":"873e3bef-3dfb-481c-b0f7-672fb510f13d","Type":"ContainerStarted","Data":"413f6ffe6b46095f0ed2de0d45ef1d8d6cbde08d99d8c609a6ec8d73876b2d08"} Jul 29 22:46:35.544772 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.544097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" event={"ID":"873e3bef-3dfb-481c-b0f7-672fb510f13d","Type":"ContainerStarted","Data":"b2a2f637aa9343873a9031f11a7f80b492c5901fe07b5dbfa39bb5b2b1391831"} Jul 29 22:46:35.544772 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.544126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" event={"ID":"873e3bef-3dfb-481c-b0f7-672fb510f13d","Type":"ContainerStarted","Data":"831aac5e60732daffd1733a0ebd23f5cf532552999cf76a6860f79b15f9e2b1f"} Jul 29 22:46:35.621584 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.621495 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:35.622163 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.622127 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:35.679685 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.679650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:35.979626 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:35.979596 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 22:46:36.304206 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.304040 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T22:46:35.979620129Z","UUID":"0b83dd93-1b4f-4e4b-b8ae-fbf826df5dc8","Handler":null,"Name":"","Endpoint":""} Jul 29 22:46:36.305708 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.305685 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 22:46:36.305898 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.305730 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 22:46:36.363447 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.363401 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:36.363620 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:36.363547 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:36.363620 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.363609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:36.363797 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:36.363772 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:36.549419 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.549383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpsdj" event={"ID":"62bf8143-aead-46e4-a8f5-9c306902e46d","Type":"ContainerStarted","Data":"55ee212f6f95003e277464e999da37854341c7d60995611906fb4146506467e6"} Jul 29 22:46:36.551760 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.551689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" event={"ID":"86dc6cda-7a7e-4518-bbd6-75c31a976df5","Type":"ContainerStarted","Data":"b23c0aee03f7532235a45eb5a452268474725602f79367cc7ff3c5a79c497cf4"} Jul 29 22:46:36.552042 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.551979 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:36.552533 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.552511 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2mpt4" Jul 29 22:46:36.564861 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.564771 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dpsdj" podStartSLOduration=5.718612663 podStartE2EDuration="24.564750998s" totalImagesPullingTime="18.846138335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:36.564561926 +0000 UTC m=+24.706133390" watchObservedRunningTime="2026-07-29 22:46:36.564750998 +0000 UTC m=+24.706322511" Jul 29 22:46:36.640331 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.640303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:36.741902 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.741865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:36.800270 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:36.800232 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:37.363524 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:37.363446 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:37.363680 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:37.363561 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:38.200354 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:38.200314 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:38.263222 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:38.263189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:38.322627 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:38.322598 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:38.364105 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:38.364069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:38.364283 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:38.364082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:38.364283 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:38.364175 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:38.364385 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:38.364289 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:39.363984 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:39.363752 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:39.364441 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:39.364039 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:39.562237 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:39.562200 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" event={"ID":"873e3bef-3dfb-481c-b0f7-672fb510f13d","Type":"ContainerStarted","Data":"5fc9d089783079dc28ca1927d7ab18e6ceefac9971737cf2de2e947afdad7e37"} Jul 29 22:46:39.563933 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:39.563906 2578 generic.go:356] "Generic (PLEG): container finished" podID="134368eb-a0bc-4dbc-aac9-8f6c4831bccd" containerID="c10f0a25f0ed132b8ca88c30f20599f75ec468f3743dca5a9eb3ea7241f02cf8" exitCode=0 Jul 29 22:46:39.564080 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:39.563958 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfds5" event={"ID":"134368eb-a0bc-4dbc-aac9-8f6c4831bccd","Type":"ContainerDied","Data":"c10f0a25f0ed132b8ca88c30f20599f75ec468f3743dca5a9eb3ea7241f02cf8"} Jul 29 22:46:39.566047 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:39.566002 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" event={"ID":"86dc6cda-7a7e-4518-bbd6-75c31a976df5","Type":"ContainerStarted","Data":"cbada2a945eb997f5532a75e86bbcf060997c5acbd06a2b5a22387d0fa0f6010"} Jul 29 22:46:39.606219 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:39.606168 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh8l6" podStartSLOduration=4.62935925 podStartE2EDuration="27.606149995s" totalImagesPullingTime="22.976790745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:39.605676185 +0000 UTC m=+27.747247658" watchObservedRunningTime="2026-07-29 22:46:39.606149995 +0000 UTC m=+27.747721457" Jul 29 22:46:39.791633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:39.791604 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:39.855621 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:39.855571 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:40.363600 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:40.363568 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:40.363792 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:40.363570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:40.363792 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:40.363709 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:40.363881 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:40.363786 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:41.364078 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.363792 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:41.364673 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:41.364094 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:41.573025 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.572976 2578 generic.go:356] "Generic (PLEG): container finished" podID="134368eb-a0bc-4dbc-aac9-8f6c4831bccd" containerID="60966f2ea893a4af41a68fea7ea5bc0001099a4e5061ef543b0d1844a2e965d1" exitCode=0 Jul 29 22:46:41.573193 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.573072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfds5" event={"ID":"134368eb-a0bc-4dbc-aac9-8f6c4831bccd","Type":"ContainerDied","Data":"60966f2ea893a4af41a68fea7ea5bc0001099a4e5061ef543b0d1844a2e965d1"} Jul 29 22:46:41.578895 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.578864 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" event={"ID":"873e3bef-3dfb-481c-b0f7-672fb510f13d","Type":"ContainerStarted","Data":"2330278ecb1f80b23bc92c7f6bdd6e637c0d6c67f9dd4a12b007782932c53322"} Jul 29 22:46:41.579244 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.579219 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:41.579380 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.579298 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:41.579380 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.579344 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:41.596704 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.596680 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:41.596834 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.596782 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:46:41.621671 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:41.621583 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" podStartSLOduration=10.710401701 podStartE2EDuration="29.621567642s" totalImagesPullingTime="18.911165941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:41.621030811 +0000 UTC m=+29.762602275" watchObservedRunningTime="2026-07-29 22:46:41.621567642 +0000 UTC m=+29.763139103" Jul 29 22:46:42.364666 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:42.364631 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:42.365195 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:42.364729 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:42.365195 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:42.364783 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:42.365195 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:42.364871 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:43.364201 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:43.363955 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:43.364357 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:43.364294 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:43.371526 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:43.371499 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g4lzk"] Jul 29 22:46:43.374750 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:43.374720 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-spv92"] Jul 29 22:46:43.374867 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:43.374843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:43.374975 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:43.374955 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:43.375810 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:43.375620 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82qwh"] Jul 29 22:46:43.375810 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:43.375710 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:43.375810 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:43.375781 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:43.585445 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:43.585365 2578 generic.go:356] "Generic (PLEG): container finished" podID="134368eb-a0bc-4dbc-aac9-8f6c4831bccd" containerID="0697da67d8d90b25830ae73c36cfe3c5d04811cb73ddfa8446ce2a53ba9e354f" exitCode=0 Jul 29 22:46:43.585582 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:43.585448 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfds5" event={"ID":"134368eb-a0bc-4dbc-aac9-8f6c4831bccd","Type":"ContainerDied","Data":"0697da67d8d90b25830ae73c36cfe3c5d04811cb73ddfa8446ce2a53ba9e354f"} Jul 29 22:46:43.585829 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:43.585812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:43.585937 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:43.585914 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:45.363134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:45.363049 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:45.363134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:45.363103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:45.363628 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:45.363059 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:45.363628 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:45.363190 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-82qwh" podUID="9f806c44-a965-4aca-b4f7-fa89e1021afa" Jul 29 22:46:45.363628 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:45.363256 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4lzk" podUID="4982c15c-9467-4626-8bd8-cbce2f480236" Jul 29 22:46:45.363628 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:45.363337 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-spv92" podUID="c429e361-e445-4d70-9d32-de7413457368" Jul 29 22:46:46.012424 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:46.010497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:46.012424 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:46.010738 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 22:46:46.012424 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:46.010759 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 22:46:46.012424 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:46.010772 2578 projected.go:196] Error preparing data for projected volume kube-api-access-d5bhl for pod openshift-network-diagnostics/network-check-target-spv92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:46.012424 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:46.010839 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl podName:c429e361-e445-4d70-9d32-de7413457368 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:18.0108202 +0000 UTC m=+66.152391642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d5bhl" (UniqueName: "kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl") pod "network-check-target-spv92" (UID: "c429e361-e445-4d70-9d32-de7413457368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 22:46:46.111938 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:46.111899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:46.111938 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:46.111945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:46.112148 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:46.112085 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:46.112148 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:46.112086 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:46.112218 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:46.112149 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs podName:9f806c44-a965-4aca-b4f7-fa89e1021afa nodeName:}" failed. No retries permitted until 2026-07-29 22:47:18.112133091 +0000 UTC m=+66.253704532 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs") pod "network-metrics-daemon-82qwh" (UID: "9f806c44-a965-4aca-b4f7-fa89e1021afa") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 22:46:46.112218 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:46.112163 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret podName:4982c15c-9467-4626-8bd8-cbce2f480236 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:18.112157083 +0000 UTC m=+66.253728522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret") pod "global-pull-secret-syncer-g4lzk" (UID: "4982c15c-9467-4626-8bd8-cbce2f480236") : object "kube-system"/"original-pull-secret" not registered Jul 29 22:46:47.179856 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.179827 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-152.ec2.internal" event="NodeReady" Jul 29 22:46:47.180220 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.179973 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 22:46:47.230489 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.230451 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9k5z6"] Jul 29 22:46:47.233374 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.233347 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.233520 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.233494 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dnww8"] Jul 29 22:46:47.235257 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.235238 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnww8" Jul 29 22:46:47.235734 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.235717 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 22:46:47.235838 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.235764 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 22:46:47.235886 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.235864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6lczg\"" Jul 29 22:46:47.237401 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.237379 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 22:46:47.237489 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.237472 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 22:46:47.237559 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.237484 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-csnkl\"" Jul 29 22:46:47.237559 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.237549 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 22:46:47.250313 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.249798 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9k5z6"] Jul 29 22:46:47.250688 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.250586 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnww8"] Jul 29 22:46:47.322392 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.322356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e311bf85-9f07-4659-b745-2ca6ac4a2852-config-volume\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.322641 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.322396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-798sl\" (UniqueName: \"kubernetes.io/projected/e311bf85-9f07-4659-b745-2ca6ac4a2852-kube-api-access-798sl\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.322641 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.322443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ffe1740-d9c0-4cdc-82c6-67cc9ae34426-cert\") pod \"ingress-canary-dnww8\" (UID: \"4ffe1740-d9c0-4cdc-82c6-67cc9ae34426\") " pod="openshift-ingress-canary/ingress-canary-dnww8" Jul 29 22:46:47.322641 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.322501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e311bf85-9f07-4659-b745-2ca6ac4a2852-tmp-dir\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.322641 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.322538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.322641 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.322560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9mwr\" (UniqueName: \"kubernetes.io/projected/4ffe1740-d9c0-4cdc-82c6-67cc9ae34426-kube-api-access-f9mwr\") pod \"ingress-canary-dnww8\" (UID: \"4ffe1740-d9c0-4cdc-82c6-67cc9ae34426\") " pod="openshift-ingress-canary/ingress-canary-dnww8" Jul 29 22:46:47.363806 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.363772 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:46:47.363976 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.363887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:46:47.364071 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.364035 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:46:47.366658 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.366637 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4fq52\"" Jul 29 22:46:47.366658 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.366653 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 22:46:47.366851 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.366663 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 22:46:47.366851 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.366781 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 22:46:47.366851 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.366811 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 22:46:47.366960 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.366931 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pbmzc\"" Jul 29 22:46:47.399889 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.399855 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:47.423845 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.423809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ffe1740-d9c0-4cdc-82c6-67cc9ae34426-cert\") pod \"ingress-canary-dnww8\" (UID: \"4ffe1740-d9c0-4cdc-82c6-67cc9ae34426\") " pod="openshift-ingress-canary/ingress-canary-dnww8" Jul 29 22:46:47.424055 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.423857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e311bf85-9f07-4659-b745-2ca6ac4a2852-tmp-dir\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.424055 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.423885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.424055 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.423910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9mwr\" (UniqueName: \"kubernetes.io/projected/4ffe1740-d9c0-4cdc-82c6-67cc9ae34426-kube-api-access-f9mwr\") pod \"ingress-canary-dnww8\" (UID: \"4ffe1740-d9c0-4cdc-82c6-67cc9ae34426\") " pod="openshift-ingress-canary/ingress-canary-dnww8" Jul 29 22:46:47.424055 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.423960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e311bf85-9f07-4659-b745-2ca6ac4a2852-config-volume\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.424055 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:47.423987 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:47.424256 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:47.424073 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls podName:e311bf85-9f07-4659-b745-2ca6ac4a2852 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:47.924051763 +0000 UTC m=+36.065623203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls") pod "dns-default-9k5z6" (UID: "e311bf85-9f07-4659-b745-2ca6ac4a2852") : secret "dns-default-metrics-tls" not found Jul 29 22:46:47.424256 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.423987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-798sl\" (UniqueName: \"kubernetes.io/projected/e311bf85-9f07-4659-b745-2ca6ac4a2852-kube-api-access-798sl\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.424375 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.424309 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e311bf85-9f07-4659-b745-2ca6ac4a2852-tmp-dir\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.424553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.424531 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e311bf85-9f07-4659-b745-2ca6ac4a2852-config-volume\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.428667 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.428644 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ffe1740-d9c0-4cdc-82c6-67cc9ae34426-cert\") pod \"ingress-canary-dnww8\" (UID: \"4ffe1740-d9c0-4cdc-82c6-67cc9ae34426\") " pod="openshift-ingress-canary/ingress-canary-dnww8" Jul 29 22:46:47.434919 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.434852 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9mwr\" (UniqueName: \"kubernetes.io/projected/4ffe1740-d9c0-4cdc-82c6-67cc9ae34426-kube-api-access-f9mwr\") pod \"ingress-canary-dnww8\" (UID: \"4ffe1740-d9c0-4cdc-82c6-67cc9ae34426\") " pod="openshift-ingress-canary/ingress-canary-dnww8" Jul 29 22:46:47.436619 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.436596 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-798sl\" (UniqueName: \"kubernetes.io/projected/e311bf85-9f07-4659-b745-2ca6ac4a2852-kube-api-access-798sl\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.500941 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.500904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:47.553411 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.553374 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnww8" Jul 29 22:46:47.705421 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.704972 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnww8"] Jul 29 22:46:47.708827 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:46:47.708799 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ffe1740_d9c0_4cdc_82c6_67cc9ae34426.slice/crio-1be9795dbd91bbd5992c5a1203410e577b421efae6a674a9cfada40291352ebc WatchSource:0}: Error finding container 1be9795dbd91bbd5992c5a1203410e577b421efae6a674a9cfada40291352ebc: Status 404 returned error can't find the container with id 1be9795dbd91bbd5992c5a1203410e577b421efae6a674a9cfada40291352ebc Jul 29 22:46:47.929285 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:47.929249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:47.929464 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:47.929371 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:47.929464 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:47.929427 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls podName:e311bf85-9f07-4659-b745-2ca6ac4a2852 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:48.929414357 +0000 UTC m=+37.070985797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls") pod "dns-default-9k5z6" (UID: "e311bf85-9f07-4659-b745-2ca6ac4a2852") : secret "dns-default-metrics-tls" not found Jul 29 22:46:48.600391 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:48.600351 2578 generic.go:356] "Generic (PLEG): container finished" podID="134368eb-a0bc-4dbc-aac9-8f6c4831bccd" containerID="d80faefa63b9c8207ed2062d81f8bfdc261e3d1264de3844bb75d0a5834b628c" exitCode=0 Jul 29 22:46:48.601190 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:48.600432 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfds5" event={"ID":"134368eb-a0bc-4dbc-aac9-8f6c4831bccd","Type":"ContainerDied","Data":"d80faefa63b9c8207ed2062d81f8bfdc261e3d1264de3844bb75d0a5834b628c"} Jul 29 22:46:48.602074 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:48.602048 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnww8" event={"ID":"4ffe1740-d9c0-4cdc-82c6-67cc9ae34426","Type":"ContainerStarted","Data":"1be9795dbd91bbd5992c5a1203410e577b421efae6a674a9cfada40291352ebc"} Jul 29 22:46:48.937044 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:48.936989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:48.937231 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:48.937158 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:48.937292 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:48.937235 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls podName:e311bf85-9f07-4659-b745-2ca6ac4a2852 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:50.937215428 +0000 UTC m=+39.078786869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls") pod "dns-default-9k5z6" (UID: "e311bf85-9f07-4659-b745-2ca6ac4a2852") : secret "dns-default-metrics-tls" not found Jul 29 22:46:49.608073 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:49.608032 2578 generic.go:356] "Generic (PLEG): container finished" podID="134368eb-a0bc-4dbc-aac9-8f6c4831bccd" containerID="179131d13239948b43db02643d9f9b2691e455f7df1557f6a1a310cd71f2052b" exitCode=0 Jul 29 22:46:49.608574 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:49.608107 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfds5" event={"ID":"134368eb-a0bc-4dbc-aac9-8f6c4831bccd","Type":"ContainerDied","Data":"179131d13239948b43db02643d9f9b2691e455f7df1557f6a1a310cd71f2052b"} Jul 29 22:46:50.529332 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:50.529155 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:50.614224 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:50.614139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zfds5" event={"ID":"134368eb-a0bc-4dbc-aac9-8f6c4831bccd","Type":"ContainerStarted","Data":"b67a51c3384ac3e3ffa7ae64487b75489b5c37ace077b3a62325940fe72deb56"} Jul 29 22:46:50.615602 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:50.615569 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnww8" event={"ID":"4ffe1740-d9c0-4cdc-82c6-67cc9ae34426","Type":"ContainerStarted","Data":"951bac8ef1022ffff9bb7a15c46afd82e85fd835067b2b7f1d6d05d921545b3d"} Jul 29 22:46:50.629213 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:50.629185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:50.639099 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:50.639050 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zfds5" podStartSLOduration=9.099446715 podStartE2EDuration="38.639031255s" totalImagesPullingTime="29.53958454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:50.637971249 +0000 UTC m=+38.779542748" watchObservedRunningTime="2026-07-29 22:46:50.639031255 +0000 UTC m=+38.780602715" Jul 29 22:46:50.655561 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:50.655513 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dnww8" podStartSLOduration=1.15434609 podStartE2EDuration="3.655498947s" totalImagesPullingTime="2.501152857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:46:50.65466565 +0000 UTC m=+38.796237111" watchObservedRunningTime="2026-07-29 22:46:50.655498947 +0000 UTC m=+38.797070409" Jul 29 22:46:50.744903 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:50.744865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:50.830867 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:50.830835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:50.954416 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:50.954379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:50.954581 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:50.954517 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:50.954581 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:50.954573 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls podName:e311bf85-9f07-4659-b745-2ca6ac4a2852 nodeName:}" failed. No retries permitted until 2026-07-29 22:46:54.954558412 +0000 UTC m=+43.096129852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls") pod "dns-default-9k5z6" (UID: "e311bf85-9f07-4659-b745-2ca6ac4a2852") : secret "dns-default-metrics-tls" not found Jul 29 22:46:52.299239 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:52.299207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:52.368838 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:52.368806 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:46:54.985863 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:46:54.985816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:46:54.986286 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:54.985975 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:46:54.986286 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:46:54.986065 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls podName:e311bf85-9f07-4659-b745-2ca6ac4a2852 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:02.986049512 +0000 UTC m=+51.127620951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls") pod "dns-default-9k5z6" (UID: "e311bf85-9f07-4659-b745-2ca6ac4a2852") : secret "dns-default-metrics-tls" not found Jul 29 22:47:00.219020 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:00.218982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:00.298367 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:00.298336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:03.043025 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:03.042966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:47:03.043590 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:03.043111 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:47:03.043590 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:03.043207 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls podName:e311bf85-9f07-4659-b745-2ca6ac4a2852 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:19.043184178 +0000 UTC m=+67.184755627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls") pod "dns-default-9k5z6" (UID: "e311bf85-9f07-4659-b745-2ca6ac4a2852") : secret "dns-default-metrics-tls" not found Jul 29 22:47:10.276811 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.276780 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv"] Jul 29 22:47:10.278693 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.278678 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv" Jul 29 22:47:10.280529 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.280505 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb"] Jul 29 22:47:10.280917 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.280896 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:47:10.281876 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.281626 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 29 22:47:10.281876 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.281782 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wdzrf\"" Jul 29 22:47:10.285177 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.283212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.285426 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.285398 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:47:10.285599 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.285573 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7gbsc\"" Jul 29 22:47:10.286416 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.286396 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 29 22:47:10.286502 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.286397 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 29 22:47:10.286940 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.286921 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 29 22:47:10.290978 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.290959 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv"] Jul 29 22:47:10.293947 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.293925 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb"] Jul 29 22:47:10.295926 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.295342 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f05580f-1566-4020-92b6-7923a0e4be5b-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb\" (UID: \"5f05580f-1566-4020-92b6-7923a0e4be5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.295926 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.295384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f05580f-1566-4020-92b6-7923a0e4be5b-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb\" (UID: \"5f05580f-1566-4020-92b6-7923a0e4be5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.295926 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.295411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmbnr\" (UniqueName: \"kubernetes.io/projected/5f05580f-1566-4020-92b6-7923a0e4be5b-kube-api-access-pmbnr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb\" (UID: \"5f05580f-1566-4020-92b6-7923a0e4be5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.295926 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.295476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn87s\" (UniqueName: \"kubernetes.io/projected/b41f0851-b749-4ca8-8311-989a6b2fc0d8-kube-api-access-kn87s\") pod \"volume-data-source-validator-549c6d54cf-nsxkv\" (UID: \"b41f0851-b749-4ca8-8311-989a6b2fc0d8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv" Jul 29 22:47:10.366823 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.366790 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj"] Jul 29 22:47:10.368557 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.368537 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-74st4"] Jul 29 22:47:10.368717 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.368670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.370256 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.370237 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq"] Jul 29 22:47:10.370383 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.370367 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:10.370807 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.370788 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 29 22:47:10.370915 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.370855 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 29 22:47:10.371164 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.371148 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 29 22:47:10.371241 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.371171 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j4zn5\"" Jul 29 22:47:10.371404 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.371386 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 29 22:47:10.372105 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.372091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:10.372510 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.372495 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mqz78\"" Jul 29 22:47:10.373143 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.373126 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 29 22:47:10.373230 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.373216 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 29 22:47:10.373844 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.373824 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 22:47:10.374148 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.374126 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zt2z7\"" Jul 29 22:47:10.374257 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.374209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 29 22:47:10.374817 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.374797 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 22:47:10.374894 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.374846 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 29 22:47:10.377604 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.377584 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj"] Jul 29 22:47:10.382106 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.382078 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-74st4"] Jul 29 22:47:10.384406 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.384389 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq"] Jul 29 22:47:10.396155 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f05580f-1566-4020-92b6-7923a0e4be5b-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb\" (UID: \"5f05580f-1566-4020-92b6-7923a0e4be5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.396274 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmbnr\" (UniqueName: \"kubernetes.io/projected/5f05580f-1566-4020-92b6-7923a0e4be5b-kube-api-access-pmbnr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb\" (UID: \"5f05580f-1566-4020-92b6-7923a0e4be5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.396274 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:10.396274 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn87s\" (UniqueName: \"kubernetes.io/projected/b41f0851-b749-4ca8-8311-989a6b2fc0d8-kube-api-access-kn87s\") pod \"volume-data-source-validator-549c6d54cf-nsxkv\" (UID: \"b41f0851-b749-4ca8-8311-989a6b2fc0d8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv" Jul 29 22:47:10.396274 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f2152b-3bf1-4fee-8e1b-3066708997fb-config\") pod \"service-ca-operator-5d6c75f84f-m85qj\" (UID: \"d5f2152b-3bf1-4fee-8e1b-3066708997fb\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.396429 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff941d05-fee4-4c44-9b88-0e1e1be6738b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:10.396429 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htssr\" (UniqueName: \"kubernetes.io/projected/d5f2152b-3bf1-4fee-8e1b-3066708997fb-kube-api-access-htssr\") pod \"service-ca-operator-5d6c75f84f-m85qj\" (UID: \"d5f2152b-3bf1-4fee-8e1b-3066708997fb\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.396429 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f2152b-3bf1-4fee-8e1b-3066708997fb-serving-cert\") pod \"service-ca-operator-5d6c75f84f-m85qj\" (UID: \"d5f2152b-3bf1-4fee-8e1b-3066708997fb\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.396429 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f05580f-1566-4020-92b6-7923a0e4be5b-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb\" (UID: \"5f05580f-1566-4020-92b6-7923a0e4be5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.396557 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:10.396557 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396545 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srmtg\" (UniqueName: \"kubernetes.io/projected/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-kube-api-access-srmtg\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:10.396667 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:10.396723 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.396706 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5f05580f-1566-4020-92b6-7923a0e4be5b-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb\" (UID: \"5f05580f-1566-4020-92b6-7923a0e4be5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.400560 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.400538 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5f05580f-1566-4020-92b6-7923a0e4be5b-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb\" (UID: \"5f05580f-1566-4020-92b6-7923a0e4be5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.406295 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.406274 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn87s\" (UniqueName: \"kubernetes.io/projected/b41f0851-b749-4ca8-8311-989a6b2fc0d8-kube-api-access-kn87s\") pod \"volume-data-source-validator-549c6d54cf-nsxkv\" (UID: \"b41f0851-b749-4ca8-8311-989a6b2fc0d8\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv" Jul 29 22:47:10.406808 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.406789 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmbnr\" (UniqueName: \"kubernetes.io/projected/5f05580f-1566-4020-92b6-7923a0e4be5b-kube-api-access-pmbnr\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb\" (UID: \"5f05580f-1566-4020-92b6-7923a0e4be5b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.473341 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.473308 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-865cc5bd4f-whfkz"] Jul 29 22:47:10.476098 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.476080 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.478968 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.478949 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 22:47:10.479161 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.479145 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 22:47:10.479242 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.479176 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwgrj\"" Jul 29 22:47:10.479392 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.479377 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 22:47:10.485825 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.485796 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 22:47:10.490679 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.490656 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865cc5bd4f-whfkz"] Jul 29 22:47:10.497783 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.497759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:10.497871 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.497804 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.497871 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.497834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f2152b-3bf1-4fee-8e1b-3066708997fb-config\") pod \"service-ca-operator-5d6c75f84f-m85qj\" (UID: \"d5f2152b-3bf1-4fee-8e1b-3066708997fb\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.497937 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.497870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-installation-pull-secrets\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.497937 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.497906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff941d05-fee4-4c44-9b88-0e1e1be6738b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:10.497937 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:10.497909 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:10.498054 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:10.497966 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls podName:bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:10.997948916 +0000 UTC m=+59.139520366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-595wq" (UID: "bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b") : secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:10.498054 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.497997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htssr\" (UniqueName: \"kubernetes.io/projected/d5f2152b-3bf1-4fee-8e1b-3066708997fb-kube-api-access-htssr\") pod \"service-ca-operator-5d6c75f84f-m85qj\" (UID: \"d5f2152b-3bf1-4fee-8e1b-3066708997fb\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.498121 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-registry-certificates\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.498121 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f2152b-3bf1-4fee-8e1b-3066708997fb-serving-cert\") pod \"service-ca-operator-5d6c75f84f-m85qj\" (UID: \"d5f2152b-3bf1-4fee-8e1b-3066708997fb\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.498121 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498111 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af537a17-6a0f-49a9-97d1-5e010d414432-ca-trust-extracted\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.498254 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-trusted-ca\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.498254 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-bound-sa-token\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.498254 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h9dz\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-kube-api-access-6h9dz\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.498351 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:10.498351 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srmtg\" (UniqueName: \"kubernetes.io/projected/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-kube-api-access-srmtg\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:10.498448 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:10.498448 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-image-registry-private-configuration\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.498546 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:10.498452 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 22:47:10.498546 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498478 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d5f2152b-3bf1-4fee-8e1b-3066708997fb-config\") pod \"service-ca-operator-5d6c75f84f-m85qj\" (UID: \"d5f2152b-3bf1-4fee-8e1b-3066708997fb\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.498546 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:10.498501 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert podName:ff941d05-fee4-4c44-9b88-0e1e1be6738b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:10.998485711 +0000 UTC m=+59.140057155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-74st4" (UID: "ff941d05-fee4-4c44-9b88-0e1e1be6738b") : secret "networking-console-plugin-cert" not found Jul 29 22:47:10.498688 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498593 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff941d05-fee4-4c44-9b88-0e1e1be6738b-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:10.498918 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.498900 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:10.500411 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.500389 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d5f2152b-3bf1-4fee-8e1b-3066708997fb-serving-cert\") pod \"service-ca-operator-5d6c75f84f-m85qj\" (UID: \"d5f2152b-3bf1-4fee-8e1b-3066708997fb\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.506930 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.506899 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htssr\" (UniqueName: \"kubernetes.io/projected/d5f2152b-3bf1-4fee-8e1b-3066708997fb-kube-api-access-htssr\") pod \"service-ca-operator-5d6c75f84f-m85qj\" (UID: \"d5f2152b-3bf1-4fee-8e1b-3066708997fb\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.507260 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.507243 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srmtg\" (UniqueName: \"kubernetes.io/projected/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-kube-api-access-srmtg\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:10.514077 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.514048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:10.592325 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.592238 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv" Jul 29 22:47:10.597859 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.597829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" Jul 29 22:47:10.599108 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599083 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-registry-certificates\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.599200 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599118 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af537a17-6a0f-49a9-97d1-5e010d414432-ca-trust-extracted\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.599200 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-trusted-ca\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.599200 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-bound-sa-token\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.599200 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h9dz\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-kube-api-access-6h9dz\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.599394 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-image-registry-private-configuration\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.599394 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.599394 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-installation-pull-secrets\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.599694 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599467 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af537a17-6a0f-49a9-97d1-5e010d414432-ca-trust-extracted\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.599694 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:10.599474 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:47:10.599694 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:10.599489 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865cc5bd4f-whfkz: secret "image-registry-tls" not found Jul 29 22:47:10.599694 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:10.599554 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls podName:af537a17-6a0f-49a9-97d1-5e010d414432 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:11.099538432 +0000 UTC m=+59.241109885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls") pod "image-registry-865cc5bd4f-whfkz" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432") : secret "image-registry-tls" not found Jul 29 22:47:10.599918 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.599703 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-registry-certificates\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.600383 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.600360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-trusted-ca\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.602143 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.602123 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-image-registry-private-configuration\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.602241 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.602218 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-installation-pull-secrets\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.610223 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.610195 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-bound-sa-token\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.611239 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.611208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:10.611239 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.611232 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h9dz\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-kube-api-access-6h9dz\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:10.679885 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.679852 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" Jul 29 22:47:10.739876 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.739824 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb"] Jul 29 22:47:10.743881 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:10.743798 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f05580f_1566_4020_92b6_7923a0e4be5b.slice/crio-993d6d4062999745c7d3e1c456d82b65e06ec36fa0710097467885fe4205c9e8 WatchSource:0}: Error finding container 993d6d4062999745c7d3e1c456d82b65e06ec36fa0710097467885fe4205c9e8: Status 404 returned error can't find the container with id 993d6d4062999745c7d3e1c456d82b65e06ec36fa0710097467885fe4205c9e8 Jul 29 22:47:10.751508 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.751485 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv"] Jul 29 22:47:10.754574 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:10.754545 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41f0851_b749_4ca8_8311_989a6b2fc0d8.slice/crio-453edd57f86f01209de6042ac2167f4ea3a25cafba1e50769d5c84a435a1dbca WatchSource:0}: Error finding container 453edd57f86f01209de6042ac2167f4ea3a25cafba1e50769d5c84a435a1dbca: Status 404 returned error can't find the container with id 453edd57f86f01209de6042ac2167f4ea3a25cafba1e50769d5c84a435a1dbca Jul 29 22:47:10.809719 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:10.809689 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj"] Jul 29 22:47:10.812718 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:10.812697 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f2152b_3bf1_4fee_8e1b_3066708997fb.slice/crio-d674e3858d6138d74bb0ec4f88996ca7d27db6fe5daa1f6194215859cdbfb65d WatchSource:0}: Error finding container d674e3858d6138d74bb0ec4f88996ca7d27db6fe5daa1f6194215859cdbfb65d: Status 404 returned error can't find the container with id d674e3858d6138d74bb0ec4f88996ca7d27db6fe5daa1f6194215859cdbfb65d Jul 29 22:47:11.003114 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:11.003078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:11.003312 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:11.003132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:11.003312 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:11.003237 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 22:47:11.003312 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:11.003288 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:11.003312 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:11.003307 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert podName:ff941d05-fee4-4c44-9b88-0e1e1be6738b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:12.00329032 +0000 UTC m=+60.144861761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-74st4" (UID: "ff941d05-fee4-4c44-9b88-0e1e1be6738b") : secret "networking-console-plugin-cert" not found Jul 29 22:47:11.003467 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:11.003408 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls podName:bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:12.003393621 +0000 UTC m=+60.144965065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-595wq" (UID: "bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b") : secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:11.103818 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:11.103773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:11.103971 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:11.103906 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:47:11.103971 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:11.103918 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865cc5bd4f-whfkz: secret "image-registry-tls" not found Jul 29 22:47:11.103971 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:11.103969 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls podName:af537a17-6a0f-49a9-97d1-5e010d414432 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:12.103953219 +0000 UTC m=+60.245524658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls") pod "image-registry-865cc5bd4f-whfkz" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432") : secret "image-registry-tls" not found Jul 29 22:47:11.663686 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:11.663622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" event={"ID":"d5f2152b-3bf1-4fee-8e1b-3066708997fb","Type":"ContainerStarted","Data":"d674e3858d6138d74bb0ec4f88996ca7d27db6fe5daa1f6194215859cdbfb65d"} Jul 29 22:47:11.665172 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:11.665136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv" event={"ID":"b41f0851-b749-4ca8-8311-989a6b2fc0d8","Type":"ContainerStarted","Data":"453edd57f86f01209de6042ac2167f4ea3a25cafba1e50769d5c84a435a1dbca"} Jul 29 22:47:11.666565 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:11.666510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" event={"ID":"5f05580f-1566-4020-92b6-7923a0e4be5b","Type":"ContainerStarted","Data":"993d6d4062999745c7d3e1c456d82b65e06ec36fa0710097467885fe4205c9e8"} Jul 29 22:47:12.015225 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:12.015145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:12.015225 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:12.015192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:12.015398 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:12.015308 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:12.015398 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:12.015310 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 22:47:12.015398 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:12.015362 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls podName:bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.015349046 +0000 UTC m=+62.156920486 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-595wq" (UID: "bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b") : secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:12.015398 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:12.015375 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert podName:ff941d05-fee4-4c44-9b88-0e1e1be6738b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.015369087 +0000 UTC m=+62.156940527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-74st4" (UID: "ff941d05-fee4-4c44-9b88-0e1e1be6738b") : secret "networking-console-plugin-cert" not found Jul 29 22:47:12.115935 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:12.115893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:12.116152 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:12.116093 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:47:12.116152 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:12.116116 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865cc5bd4f-whfkz: secret "image-registry-tls" not found Jul 29 22:47:12.116276 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:12.116180 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls podName:af537a17-6a0f-49a9-97d1-5e010d414432 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.116157325 +0000 UTC m=+62.257728765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls") pod "image-registry-865cc5bd4f-whfkz" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432") : secret "image-registry-tls" not found Jul 29 22:47:13.277496 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.277413 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fpl45"] Jul 29 22:47:13.286974 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.286899 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:13.293990 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.293462 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.299682 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.297174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 22:47:13.299682 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.297393 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p4nhh\"" Jul 29 22:47:13.299682 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.297578 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 22:47:13.299682 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.297772 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 22:47:13.299682 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.297935 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 22:47:13.301686 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.301661 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fpl45"] Jul 29 22:47:13.326962 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.326929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q2cz\" (UniqueName: \"kubernetes.io/projected/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-api-access-5q2cz\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.327165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.326972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.327165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.327027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/61ac32af-4913-4663-adf4-a3daf0ce973c-data-volume\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.327324 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.327194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.327324 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.327259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/61ac32af-4913-4663-adf4-a3daf0ce973c-crio-socket\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.386063 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.385998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:13.428353 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.428316 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/61ac32af-4913-4663-adf4-a3daf0ce973c-data-volume\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.428545 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.428392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.428545 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.428442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/61ac32af-4913-4663-adf4-a3daf0ce973c-crio-socket\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.428545 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:13.428532 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:13.428545 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.428540 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q2cz\" (UniqueName: \"kubernetes.io/projected/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-api-access-5q2cz\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.428722 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.428568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.428722 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.428597 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/61ac32af-4913-4663-adf4-a3daf0ce973c-crio-socket\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.428722 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:13.428632 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:13.928613399 +0000 UTC m=+62.070184845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : configmap "kube-rbac-proxy" not found Jul 29 22:47:13.428722 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.428704 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/61ac32af-4913-4663-adf4-a3daf0ce973c-data-volume\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.428722 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:13.428711 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:13.428915 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:13.428767 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:13.928754491 +0000 UTC m=+62.070325931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:13.444130 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.444103 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q2cz\" (UniqueName: \"kubernetes.io/projected/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-api-access-5q2cz\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.596971 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.596942 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nv5w8" Jul 29 22:47:13.674168 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.674126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" event={"ID":"d5f2152b-3bf1-4fee-8e1b-3066708997fb","Type":"ContainerStarted","Data":"215369f4368b9ee338fb14d67eb4bcba3e2acff620505daac03be888ac989371"} Jul 29 22:47:13.675947 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.675921 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv" event={"ID":"b41f0851-b749-4ca8-8311-989a6b2fc0d8","Type":"ContainerStarted","Data":"acaa54c7848b44d2544c2184f890a2692a31765fe2b6ad6a86db8360ae9f5f45"} Jul 29 22:47:13.677444 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.677423 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" event={"ID":"5f05580f-1566-4020-92b6-7923a0e4be5b","Type":"ContainerStarted","Data":"6bf7a733e304d38113b9aa3062c1f6170431eed99571d8f99198901f2408f7a4"} Jul 29 22:47:13.695591 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.695544 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" podStartSLOduration=1.036158973 podStartE2EDuration="3.695529606s" totalImagesPullingTime="2.659370633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:13.694838529 +0000 UTC m=+61.836409993" watchObservedRunningTime="2026-07-29 22:47:13.695529606 +0000 UTC m=+61.837101067" Jul 29 22:47:13.711490 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.711258 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-nsxkv" podStartSLOduration=1.004863934 podStartE2EDuration="3.711241297s" totalImagesPullingTime="2.706377363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:13.710784959 +0000 UTC m=+61.852356424" watchObservedRunningTime="2026-07-29 22:47:13.711241297 +0000 UTC m=+61.852812794" Jul 29 22:47:13.727721 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.727659 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" podStartSLOduration=1.001070071 podStartE2EDuration="3.72763782s" totalImagesPullingTime="2.726567749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:13.727416142 +0000 UTC m=+61.868987605" watchObservedRunningTime="2026-07-29 22:47:13.72763782 +0000 UTC m=+61.869209285" Jul 29 22:47:13.740609 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.740581 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:13.840403 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.840313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:13.932741 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.932714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.932902 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.932822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:13.932902 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:13.932865 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:13.933029 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:13.932925 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:13.933029 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:13.932960 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.93293753 +0000 UTC m=+63.074508985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : configmap "kube-rbac-proxy" not found Jul 29 22:47:13.933029 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:13.932982 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:14.932971573 +0000 UTC m=+63.074543019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:13.939446 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:13.939418 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:14.034570 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:14.034523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:14.034825 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:14.034798 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:14.035449 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.035428 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:14.035719 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.035707 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls podName:bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:18.035675305 +0000 UTC m=+66.177246759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-595wq" (UID: "bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b") : secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:14.036440 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.036418 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 22:47:14.036633 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.036606 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert podName:ff941d05-fee4-4c44-9b88-0e1e1be6738b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:18.036580863 +0000 UTC m=+66.178152317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-74st4" (UID: "ff941d05-fee4-4c44-9b88-0e1e1be6738b") : secret "networking-console-plugin-cert" not found Jul 29 22:47:14.135874 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:14.135830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:14.136049 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.135994 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:47:14.136049 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.136029 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865cc5bd4f-whfkz: secret "image-registry-tls" not found Jul 29 22:47:14.136137 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.136118 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls podName:af537a17-6a0f-49a9-97d1-5e010d414432 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:18.136099876 +0000 UTC m=+66.277671329 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls") pod "image-registry-865cc5bd4f-whfkz" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432") : secret "image-registry-tls" not found Jul 29 22:47:14.853334 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:14.853301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:14.943224 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:14.943175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:14.943401 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:14.943255 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:14.943401 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.943326 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:14.943401 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.943337 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:14.943401 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.943394 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:16.943380417 +0000 UTC m=+65.084951857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : configmap "kube-rbac-proxy" not found Jul 29 22:47:14.943613 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:14.943407 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:16.943400717 +0000 UTC m=+65.084972158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:14.945904 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:14.945882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:14.978435 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:14.978412 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bsjll_89f03d30-531d-4ea5-855b-e8649825f324/dns-node-resolver/0.log" Jul 29 22:47:15.046708 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:15.046667 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:15.245441 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:15.245406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:15.499219 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:15.499129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:15.574984 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:15.574953 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:15.943651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:15.943622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:16.047125 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:16.047092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:16.380866 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:16.380793 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-thx5l_441350f3-019d-46d2-a6de-9036c164e19b/node-ca/0.log" Jul 29 22:47:16.960774 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:16.960738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:16.961210 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:16.960847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:16.961210 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:16.960883 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:16.961210 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:16.960953 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:20.960935669 +0000 UTC m=+69.102507111 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : configmap "kube-rbac-proxy" not found Jul 29 22:47:16.961210 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:16.960962 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:16.961210 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:16.961029 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:20.960992611 +0000 UTC m=+69.102564053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:17.179252 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:17.179222 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnww8_4ffe1740-d9c0-4cdc-82c6-67cc9ae34426/serve-healthcheck-canary/0.log" Jul 29 22:47:17.316880 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:17.316789 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:17.415030 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:17.414979 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:17.663315 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:17.663281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:17.763956 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:17.763924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:18.071627 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.071516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:18.071627 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.071582 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:18.072186 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:18.071668 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 22:47:18.072186 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.071705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:47:18.072186 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:18.071731 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert podName:ff941d05-fee4-4c44-9b88-0e1e1be6738b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:26.071716215 +0000 UTC m=+74.213287658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-74st4" (UID: "ff941d05-fee4-4c44-9b88-0e1e1be6738b") : secret "networking-console-plugin-cert" not found Jul 29 22:47:18.072186 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:18.071731 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:18.072186 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:18.071789 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls podName:bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:26.071772796 +0000 UTC m=+74.213344236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-595wq" (UID: "bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b") : secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:18.074385 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.074369 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 22:47:18.083843 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.083826 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 22:47:18.095304 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.095280 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5bhl\" (UniqueName: \"kubernetes.io/projected/c429e361-e445-4d70-9d32-de7413457368-kube-api-access-d5bhl\") pod \"network-check-target-spv92\" (UID: \"c429e361-e445-4d70-9d32-de7413457368\") " pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:47:18.172899 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.172854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:18.172899 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.172911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:47:18.173156 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.172931 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:47:18.173156 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:18.173042 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 22:47:18.173156 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:18.173062 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865cc5bd4f-whfkz: secret "image-registry-tls" not found Jul 29 22:47:18.173156 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:18.173115 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls podName:af537a17-6a0f-49a9-97d1-5e010d414432 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:26.173100838 +0000 UTC m=+74.314672278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls") pod "image-registry-865cc5bd4f-whfkz" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432") : secret "image-registry-tls" not found Jul 29 22:47:18.175451 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.175431 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 22:47:18.175553 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.175450 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 22:47:18.183752 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:18.183735 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 22:47:18.183812 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:18.183788 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs podName:9f806c44-a965-4aca-b4f7-fa89e1021afa nodeName:}" failed. No retries permitted until 2026-07-29 22:48:22.183774944 +0000 UTC m=+130.325346384 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs") pod "network-metrics-daemon-82qwh" (UID: "9f806c44-a965-4aca-b4f7-fa89e1021afa") : secret "metrics-daemon-secret" not found Jul 29 22:47:18.185984 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.185962 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4982c15c-9467-4626-8bd8-cbce2f480236-original-pull-secret\") pod \"global-pull-secret-syncer-g4lzk\" (UID: \"4982c15c-9467-4626-8bd8-cbce2f480236\") " pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:47:18.277761 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.277725 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pbmzc\"" Jul 29 22:47:18.285613 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.285593 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:47:18.287683 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.287664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4lzk" Jul 29 22:47:18.418987 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.418957 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-spv92"] Jul 29 22:47:18.422418 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:18.422389 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc429e361_e445_4d70_9d32_de7413457368.slice/crio-63389eb1f8f4044e1b6cb14da6d31aed2ca6e41357322961ca527ecb37d7380e WatchSource:0}: Error finding container 63389eb1f8f4044e1b6cb14da6d31aed2ca6e41357322961ca527ecb37d7380e: Status 404 returned error can't find the container with id 63389eb1f8f4044e1b6cb14da6d31aed2ca6e41357322961ca527ecb37d7380e Jul 29 22:47:18.433930 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.433907 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g4lzk"] Jul 29 22:47:18.436523 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:18.436498 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4982c15c_9467_4626_8bd8_cbce2f480236.slice/crio-9008270f7d14691e5acea75b5f5a1d61ada2eb0bbcae8f1b0cb19d91fb68b52b WatchSource:0}: Error finding container 9008270f7d14691e5acea75b5f5a1d61ada2eb0bbcae8f1b0cb19d91fb68b52b: Status 404 returned error can't find the container with id 9008270f7d14691e5acea75b5f5a1d61ada2eb0bbcae8f1b0cb19d91fb68b52b Jul 29 22:47:18.481435 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.481405 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:18.691268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.691228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g4lzk" event={"ID":"4982c15c-9467-4626-8bd8-cbce2f480236","Type":"ContainerStarted","Data":"9008270f7d14691e5acea75b5f5a1d61ada2eb0bbcae8f1b0cb19d91fb68b52b"} Jul 29 22:47:18.692229 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:18.692209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-spv92" event={"ID":"c429e361-e445-4d70-9d32-de7413457368","Type":"ContainerStarted","Data":"63389eb1f8f4044e1b6cb14da6d31aed2ca6e41357322961ca527ecb37d7380e"} Jul 29 22:47:19.082828 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:19.082739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:47:19.083263 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:19.082933 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 22:47:19.083263 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:19.083051 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls podName:e311bf85-9f07-4659-b745-2ca6ac4a2852 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:51.083000817 +0000 UTC m=+99.224572274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls") pod "dns-default-9k5z6" (UID: "e311bf85-9f07-4659-b745-2ca6ac4a2852") : secret "dns-default-metrics-tls" not found Jul 29 22:47:20.999592 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:20.999552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:21.000065 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:20.999685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:21.000065 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:20.999793 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 22:47:21.000065 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:20.999869 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:28.999853474 +0000 UTC m=+77.141424914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : configmap "kube-rbac-proxy" not found Jul 29 22:47:21.000330 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:21.000315 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:21.000391 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:21.000371 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:29.000355122 +0000 UTC m=+77.141926606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:21.222299 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:21.222264 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:21.325257 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:21.325146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:21.427041 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:21.426982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:21.595025 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:21.594926 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:21.698216 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:21.698179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:21.793546 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:21.793508 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:21.906919 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:21.906867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:22.906028 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:22.905982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:23.308697 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:23.308615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:23.519350 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:23.519287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:23.707827 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:23.707787 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-spv92" event={"ID":"c429e361-e445-4d70-9d32-de7413457368","Type":"ContainerStarted","Data":"95ab1b13641428dd45ab5d0df679dffe6285f0f5656b6157ee2fa12b788ea220"} Jul 29 22:47:23.708055 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:23.707892 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:47:23.709296 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:23.709255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g4lzk" event={"ID":"4982c15c-9467-4626-8bd8-cbce2f480236","Type":"ContainerStarted","Data":"c8b67e2b9f0929dd9f0cf04246f40fc5d9f4f9998a27ca7eb41b00ce0e004265"} Jul 29 22:47:23.709296 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:23.709258 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:23.725719 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:23.725662 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-spv92" podStartSLOduration=67.186581506 podStartE2EDuration="1m11.72563347s" totalImagesPullingTime="4.539051964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:23.725499766 +0000 UTC m=+71.867071228" watchObservedRunningTime="2026-07-29 22:47:23.72563347 +0000 UTC m=+71.867204934" Jul 29 22:47:23.742018 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:23.741970 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g4lzk" podStartSLOduration=67.214046767 podStartE2EDuration="1m11.741952775s" totalImagesPullingTime="4.527906008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:23.741385261 +0000 UTC m=+71.882956726" watchObservedRunningTime="2026-07-29 22:47:23.741952775 +0000 UTC m=+71.883524237" Jul 29 22:47:23.913231 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:23.913194 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:24.918211 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:24.918163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:25.023922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:25.023864 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:25.123367 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:25.123332 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:25.325246 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:25.325131 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:25.521446 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:25.521408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:25.716400 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:25.716368 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:25.817651 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:25.817624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:25.926311 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:25.926276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:26.139928 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.139902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:26.140088 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.139940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:26.140088 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:26.140074 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 29 22:47:26.140157 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:26.140133 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert podName:ff941d05-fee4-4c44-9b88-0e1e1be6738b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:42.140119225 +0000 UTC m=+90.281690664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-74st4" (UID: "ff941d05-fee4-4c44-9b88-0e1e1be6738b") : secret "networking-console-plugin-cert" not found Jul 29 22:47:26.140194 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:26.140074 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:26.140229 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:26.140195 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls podName:bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b nodeName:}" failed. No retries permitted until 2026-07-29 22:47:42.140184307 +0000 UTC m=+90.281755749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-595wq" (UID: "bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b") : secret "cluster-monitoring-operator-tls" not found Jul 29 22:47:26.241297 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.241269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:26.243859 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.243830 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") pod \"image-registry-865cc5bd4f-whfkz\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:26.387141 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.387111 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwgrj\"" Jul 29 22:47:26.395881 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.395817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:26.455903 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.455834 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:26.526269 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.526241 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865cc5bd4f-whfkz"] Jul 29 22:47:26.529356 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:26.529328 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf537a17_6a0f_49a9_97d1_5e010d414432.slice/crio-6ad9a30003cfb5e2bb588a138fac994a8ce795be03e93f23f036f9b42b5ed9a0 WatchSource:0}: Error finding container 6ad9a30003cfb5e2bb588a138fac994a8ce795be03e93f23f036f9b42b5ed9a0: Status 404 returned error can't find the container with id 6ad9a30003cfb5e2bb588a138fac994a8ce795be03e93f23f036f9b42b5ed9a0 Jul 29 22:47:26.724633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.724545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" event={"ID":"af537a17-6a0f-49a9-97d1-5e010d414432","Type":"ContainerStarted","Data":"a37d273abefcc22242bc6ff2b634dfb7d451876325c019d56cc2288b617da9ff"} Jul 29 22:47:26.724633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.724617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" event={"ID":"af537a17-6a0f-49a9-97d1-5e010d414432","Type":"ContainerStarted","Data":"6ad9a30003cfb5e2bb588a138fac994a8ce795be03e93f23f036f9b42b5ed9a0"} Jul 29 22:47:26.724821 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.724692 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:26.750953 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.750903 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" podStartSLOduration=16.750887299 podStartE2EDuration="16.750887299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:26.749352186 +0000 UTC m=+74.890923648" watchObservedRunningTime="2026-07-29 22:47:26.750887299 +0000 UTC m=+74.892458761" Jul 29 22:47:26.904780 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:26.904748 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:27.183149 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:27.183120 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:27.262301 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:27.262271 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:27.343308 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:27.343267 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:27.509973 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:27.509892 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:27.619211 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:27.619177 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:27.712024 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:27.711981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:27.908765 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:27.908728 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:28.931781 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:28.931733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:29.063158 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:29.063115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:29.063402 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:29.063187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:29.063402 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:29.063277 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 22:47:29.063402 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:29.063347 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls podName:61ac32af-4913-4663-adf4-a3daf0ce973c nodeName:}" failed. No retries permitted until 2026-07-29 22:47:45.063328463 +0000 UTC m=+93.204899902 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fpl45" (UID: "61ac32af-4913-4663-adf4-a3daf0ce973c") : secret "insights-runtime-extractor-tls" not found Jul 29 22:47:29.063735 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:29.063714 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/61ac32af-4913-4663-adf4-a3daf0ce973c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:29.122869 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:29.122835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:29.313886 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:29.313802 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:29.518565 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:29.518530 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:30.186306 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:30.186270 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:30.517733 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:30.517651 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:30.916804 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:30.916774 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:31.116421 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:31.116392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:31.322233 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:31.322144 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:31.511807 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:31.511778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:31.913973 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:31.913939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:36.652428 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.652317 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9"] Jul 29 22:47:36.656955 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.656934 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" Jul 29 22:47:36.660195 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.660174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 22:47:36.660278 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.660256 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 29 22:47:36.660348 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.660185 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 22:47:36.660472 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.660453 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6hw98\"" Jul 29 22:47:36.661576 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.661564 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 22:47:36.666305 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.666282 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9"] Jul 29 22:47:36.703041 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.702991 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-865cc5bd4f-whfkz"] Jul 29 22:47:36.726794 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.723874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69jb5\" (UniqueName: \"kubernetes.io/projected/f79d0e42-87db-484e-a4f3-3d1891ea49e6-kube-api-access-69jb5\") pod \"managed-serviceaccount-addon-agent-784fb75956-hqnz9\" (UID: \"f79d0e42-87db-484e-a4f3-3d1891ea49e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" Jul 29 22:47:36.726794 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.723938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f79d0e42-87db-484e-a4f3-3d1891ea49e6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-784fb75956-hqnz9\" (UID: \"f79d0e42-87db-484e-a4f3-3d1891ea49e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" Jul 29 22:47:36.749304 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.749266 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c5f5cc688-br88b"] Jul 29 22:47:36.752675 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.752651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.765849 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.765823 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5f5cc688-br88b"] Jul 29 22:47:36.824460 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8af1ac0a-4941-4084-bdc1-a26cc03f5301-installation-pull-secrets\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.824460 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8af1ac0a-4941-4084-bdc1-a26cc03f5301-bound-sa-token\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.824698 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btq4f\" (UniqueName: \"kubernetes.io/projected/8af1ac0a-4941-4084-bdc1-a26cc03f5301-kube-api-access-btq4f\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.824698 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8af1ac0a-4941-4084-bdc1-a26cc03f5301-image-registry-private-configuration\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.824698 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824584 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69jb5\" (UniqueName: \"kubernetes.io/projected/f79d0e42-87db-484e-a4f3-3d1891ea49e6-kube-api-access-69jb5\") pod \"managed-serviceaccount-addon-agent-784fb75956-hqnz9\" (UID: \"f79d0e42-87db-484e-a4f3-3d1891ea49e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" Jul 29 22:47:36.824698 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f79d0e42-87db-484e-a4f3-3d1891ea49e6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-784fb75956-hqnz9\" (UID: \"f79d0e42-87db-484e-a4f3-3d1891ea49e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" Jul 29 22:47:36.824698 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8af1ac0a-4941-4084-bdc1-a26cc03f5301-ca-trust-extracted\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.824698 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8af1ac0a-4941-4084-bdc1-a26cc03f5301-trusted-ca\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.825067 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8af1ac0a-4941-4084-bdc1-a26cc03f5301-registry-certificates\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.825067 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.824867 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af1ac0a-4941-4084-bdc1-a26cc03f5301-registry-tls\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.827191 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.827174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f79d0e42-87db-484e-a4f3-3d1891ea49e6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-784fb75956-hqnz9\" (UID: \"f79d0e42-87db-484e-a4f3-3d1891ea49e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" Jul 29 22:47:36.832823 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.832796 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:36.834912 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.834896 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69jb5\" (UniqueName: \"kubernetes.io/projected/f79d0e42-87db-484e-a4f3-3d1891ea49e6-kube-api-access-69jb5\") pod \"managed-serviceaccount-addon-agent-784fb75956-hqnz9\" (UID: \"f79d0e42-87db-484e-a4f3-3d1891ea49e6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" Jul 29 22:47:36.925983 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.925885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8af1ac0a-4941-4084-bdc1-a26cc03f5301-registry-certificates\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.925983 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.925947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af1ac0a-4941-4084-bdc1-a26cc03f5301-registry-tls\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.925983 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.925971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8af1ac0a-4941-4084-bdc1-a26cc03f5301-installation-pull-secrets\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.925983 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.925988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8af1ac0a-4941-4084-bdc1-a26cc03f5301-bound-sa-token\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.926349 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.926004 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btq4f\" (UniqueName: \"kubernetes.io/projected/8af1ac0a-4941-4084-bdc1-a26cc03f5301-kube-api-access-btq4f\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.926349 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.926042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8af1ac0a-4941-4084-bdc1-a26cc03f5301-image-registry-private-configuration\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.926349 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.926110 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8af1ac0a-4941-4084-bdc1-a26cc03f5301-ca-trust-extracted\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.926349 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.926134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8af1ac0a-4941-4084-bdc1-a26cc03f5301-trusted-ca\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.926821 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.926754 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8af1ac0a-4941-4084-bdc1-a26cc03f5301-ca-trust-extracted\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.926821 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.926814 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8af1ac0a-4941-4084-bdc1-a26cc03f5301-registry-certificates\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.927256 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.927234 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8af1ac0a-4941-4084-bdc1-a26cc03f5301-trusted-ca\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.928678 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.928653 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8af1ac0a-4941-4084-bdc1-a26cc03f5301-installation-pull-secrets\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.928678 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.928670 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8af1ac0a-4941-4084-bdc1-a26cc03f5301-image-registry-private-configuration\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.928815 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.928719 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8af1ac0a-4941-4084-bdc1-a26cc03f5301-registry-tls\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.940600 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.940571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btq4f\" (UniqueName: \"kubernetes.io/projected/8af1ac0a-4941-4084-bdc1-a26cc03f5301-kube-api-access-btq4f\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.941377 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.941359 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8af1ac0a-4941-4084-bdc1-a26cc03f5301-bound-sa-token\") pod \"image-registry-6c5f5cc688-br88b\" (UID: \"8af1ac0a-4941-4084-bdc1-a26cc03f5301\") " pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:36.943721 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.943702 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:36.977406 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:36.977373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" Jul 29 22:47:37.062408 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:37.062366 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:37.112409 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:37.112378 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9"] Jul 29 22:47:37.116466 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:37.116430 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf79d0e42_87db_484e_a4f3_3d1891ea49e6.slice/crio-380800b3e21a546877143c619ac32bed478b687199993e30ac3741b124c1eddf WatchSource:0}: Error finding container 380800b3e21a546877143c619ac32bed478b687199993e30ac3741b124c1eddf: Status 404 returned error can't find the container with id 380800b3e21a546877143c619ac32bed478b687199993e30ac3741b124c1eddf Jul 29 22:47:37.196911 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:37.196838 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c5f5cc688-br88b"] Jul 29 22:47:37.200117 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:37.200092 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af1ac0a_4941_4084_bdc1_a26cc03f5301.slice/crio-844f1ef5920db65fd6197694945457a37304e0bd05aa003f83373492862f770f WatchSource:0}: Error finding container 844f1ef5920db65fd6197694945457a37304e0bd05aa003f83373492862f770f: Status 404 returned error can't find the container with id 844f1ef5920db65fd6197694945457a37304e0bd05aa003f83373492862f770f Jul 29 22:47:37.759518 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:37.759480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" event={"ID":"8af1ac0a-4941-4084-bdc1-a26cc03f5301","Type":"ContainerStarted","Data":"79fefe8f3d0055214b6b46c7cc3823122e40c2e4498f731e0e808c39d199f974"} Jul 29 22:47:37.759928 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:37.759531 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" event={"ID":"8af1ac0a-4941-4084-bdc1-a26cc03f5301","Type":"ContainerStarted","Data":"844f1ef5920db65fd6197694945457a37304e0bd05aa003f83373492862f770f"} Jul 29 22:47:37.759928 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:37.759606 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:37.760634 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:37.760609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" event={"ID":"f79d0e42-87db-484e-a4f3-3d1891ea49e6","Type":"ContainerStarted","Data":"380800b3e21a546877143c619ac32bed478b687199993e30ac3741b124c1eddf"} Jul 29 22:47:37.790275 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:37.790224 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" podStartSLOduration=1.7902068629999999 podStartE2EDuration="1.790206863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:37.789478776 +0000 UTC m=+85.931050237" watchObservedRunningTime="2026-07-29 22:47:37.790206863 +0000 UTC m=+85.931778303" Jul 29 22:47:39.770296 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:39.770260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" event={"ID":"f79d0e42-87db-484e-a4f3-3d1891ea49e6","Type":"ContainerStarted","Data":"8572a287075680f62d22aea5cfd9920b7011e4f6a95868c37a924c1e12a0be2a"} Jul 29 22:47:39.787432 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:39.787385 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-784fb75956-hqnz9" podStartSLOduration=1.25495844 podStartE2EDuration="3.787369816s" totalImagesPullingTime="2.532411376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:39.786057816 +0000 UTC m=+87.927629272" watchObservedRunningTime="2026-07-29 22:47:39.787369816 +0000 UTC m=+87.928941278" Jul 29 22:47:42.170235 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.170192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:42.170235 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.170236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:42.172814 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.172791 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-595wq\" (UID: \"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:42.172920 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.172855 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ff941d05-fee4-4c44-9b88-0e1e1be6738b-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-74st4\" (UID: \"ff941d05-fee4-4c44-9b88-0e1e1be6738b\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:42.190133 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.190101 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mqz78\"" Jul 29 22:47:42.194273 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.194256 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zt2z7\"" Jul 29 22:47:42.198027 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.197994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" Jul 29 22:47:42.203067 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.203047 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" Jul 29 22:47:42.338467 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.338436 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-74st4"] Jul 29 22:47:42.341119 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:42.341098 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff941d05_fee4_4c44_9b88_0e1e1be6738b.slice/crio-225eed905fc935f06ea337399a2e4b401f24610dfa70a8b36103564bf1697cc7 WatchSource:0}: Error finding container 225eed905fc935f06ea337399a2e4b401f24610dfa70a8b36103564bf1697cc7: Status 404 returned error can't find the container with id 225eed905fc935f06ea337399a2e4b401f24610dfa70a8b36103564bf1697cc7 Jul 29 22:47:42.355933 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.355912 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq"] Jul 29 22:47:42.360822 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:42.360793 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5c2d15_2a95_46ac_b98a_e0ed5c6f104b.slice/crio-d8c0a225e89c718430e06f90d846bf9e90a28ab5d36230a5b820940874239ab9 WatchSource:0}: Error finding container d8c0a225e89c718430e06f90d846bf9e90a28ab5d36230a5b820940874239ab9: Status 404 returned error can't find the container with id d8c0a225e89c718430e06f90d846bf9e90a28ab5d36230a5b820940874239ab9 Jul 29 22:47:42.779893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.779852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" event={"ID":"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b","Type":"ContainerStarted","Data":"d8c0a225e89c718430e06f90d846bf9e90a28ab5d36230a5b820940874239ab9"} Jul 29 22:47:42.780808 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:42.780789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" event={"ID":"ff941d05-fee4-4c44-9b88-0e1e1be6738b","Type":"ContainerStarted","Data":"225eed905fc935f06ea337399a2e4b401f24610dfa70a8b36103564bf1697cc7"} Jul 29 22:47:44.343597 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:44.343525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:44.440264 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:44.440230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:44.516495 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:44.516448 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:44.789302 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:44.789263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" event={"ID":"bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b","Type":"ContainerStarted","Data":"405e3dcf3eda21180251fb8f3740b2a66ad43ac2d09054090c290315d17ae42a"} Jul 29 22:47:44.790794 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:44.790771 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" event={"ID":"ff941d05-fee4-4c44-9b88-0e1e1be6738b","Type":"ContainerStarted","Data":"d2146be1c7cadb3660ed66102d731f46b3d8b16552a8f66dcb90fbf2894443a6"} Jul 29 22:47:44.806582 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:44.806531 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-595wq" podStartSLOduration=33.171673114 podStartE2EDuration="34.806513758s" totalImagesPullingTime="1.634840644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:44.80637467 +0000 UTC m=+92.947946132" watchObservedRunningTime="2026-07-29 22:47:44.806513758 +0000 UTC m=+92.948085219" Jul 29 22:47:44.823339 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:44.823296 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-74st4" podStartSLOduration=33.172097776 podStartE2EDuration="34.823281015s" totalImagesPullingTime="1.651183239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:44.822729168 +0000 UTC m=+92.964300629" watchObservedRunningTime="2026-07-29 22:47:44.823281015 +0000 UTC m=+92.964852477" Jul 29 22:47:44.945888 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:44.945845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:45.044378 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:45.044292 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:45.097190 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:45.097161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:45.099672 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:45.099648 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/61ac32af-4913-4663-adf4-a3daf0ce973c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fpl45\" (UID: \"61ac32af-4913-4663-adf4-a3daf0ce973c\") " pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:45.109663 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:45.109640 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fpl45" Jul 29 22:47:45.145589 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:45.145550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:45.256829 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:45.256793 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fpl45"] Jul 29 22:47:45.260469 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:45.260441 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ac32af_4913_4663_adf4_a3daf0ce973c.slice/crio-ae7a8717d07094fca55111febf383f07b74e58c5853279c8be69ea3b83198fc1 WatchSource:0}: Error finding container ae7a8717d07094fca55111febf383f07b74e58c5853279c8be69ea3b83198fc1: Status 404 returned error can't find the container with id ae7a8717d07094fca55111febf383f07b74e58c5853279c8be69ea3b83198fc1 Jul 29 22:47:45.796904 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:45.796863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fpl45" event={"ID":"61ac32af-4913-4663-adf4-a3daf0ce973c","Type":"ContainerStarted","Data":"ae7a8717d07094fca55111febf383f07b74e58c5853279c8be69ea3b83198fc1"} Jul 29 22:47:46.709469 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:46.709424 2578 patch_prober.go:28] interesting pod/image-registry-865cc5bd4f-whfkz container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 29 22:47:46.709730 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:46.709505 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" podUID="af537a17-6a0f-49a9-97d1-5e010d414432" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 29 22:47:48.564423 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.564378 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:48.598260 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.598226 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8rkln"] Jul 29 22:47:48.623214 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.623179 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8rkln"] Jul 29 22:47:48.623402 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.623320 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.626765 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.626484 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 22:47:48.626765 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.626521 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 22:47:48.626765 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.626553 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mppnn\"" Jul 29 22:47:48.626765 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.626622 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 22:47:48.661489 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.661452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:48.728086 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.728049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75849f87-4425-4b07-b32e-ea6df72ad69e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.728277 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.728113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/75849f87-4425-4b07-b32e-ea6df72ad69e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.728277 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.728138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsjhr\" (UniqueName: \"kubernetes.io/projected/75849f87-4425-4b07-b32e-ea6df72ad69e-kube-api-access-gsjhr\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.728277 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.728172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75849f87-4425-4b07-b32e-ea6df72ad69e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.730957 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.730924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:48.829103 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.828983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75849f87-4425-4b07-b32e-ea6df72ad69e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.829103 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.829067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/75849f87-4425-4b07-b32e-ea6df72ad69e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.829103 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.829100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsjhr\" (UniqueName: \"kubernetes.io/projected/75849f87-4425-4b07-b32e-ea6df72ad69e-kube-api-access-gsjhr\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.829353 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.829132 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75849f87-4425-4b07-b32e-ea6df72ad69e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.829748 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.829719 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75849f87-4425-4b07-b32e-ea6df72ad69e-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.831961 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.831939 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/75849f87-4425-4b07-b32e-ea6df72ad69e-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.832106 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.832039 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75849f87-4425-4b07-b32e-ea6df72ad69e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.838704 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.838680 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsjhr\" (UniqueName: \"kubernetes.io/projected/75849f87-4425-4b07-b32e-ea6df72ad69e-kube-api-access-gsjhr\") pod \"prometheus-operator-84d69f794d-8rkln\" (UID: \"75849f87-4425-4b07-b32e-ea6df72ad69e\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:48.936910 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:48.936872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" Jul 29 22:47:50.124221 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:50.124195 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-8rkln"] Jul 29 22:47:50.127687 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:50.127665 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75849f87_4425_4b07_b32e_ea6df72ad69e.slice/crio-413bb3a1b4bc11a2c453964a173cf89e3097eb633fb1070ad346c5d04126ce93 WatchSource:0}: Error finding container 413bb3a1b4bc11a2c453964a173cf89e3097eb633fb1070ad346c5d04126ce93: Status 404 returned error can't find the container with id 413bb3a1b4bc11a2c453964a173cf89e3097eb633fb1070ad346c5d04126ce93 Jul 29 22:47:50.641135 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:50.641094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:50.742156 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:50.742074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:50.818319 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:50.818182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fpl45" event={"ID":"61ac32af-4913-4663-adf4-a3daf0ce973c","Type":"ContainerStarted","Data":"c36aee6529a6316f1c9d064d7d45afe7e79ef275a573fca1323c38bcd7f76b18"} Jul 29 22:47:50.820169 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:50.820116 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" event={"ID":"75849f87-4425-4b07-b32e-ea6df72ad69e","Type":"ContainerStarted","Data":"413bb3a1b4bc11a2c453964a173cf89e3097eb633fb1070ad346c5d04126ce93"} Jul 29 22:47:51.147188 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.147140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:47:51.151563 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.151530 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e311bf85-9f07-4659-b745-2ca6ac4a2852-metrics-tls\") pod \"dns-default-9k5z6\" (UID: \"e311bf85-9f07-4659-b745-2ca6ac4a2852\") " pod="openshift-dns/dns-default-9k5z6" Jul 29 22:47:51.448409 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.448383 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6lczg\"" Jul 29 22:47:51.456571 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.456539 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9k5z6" Jul 29 22:47:51.653027 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.652978 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9k5z6"] Jul 29 22:47:51.656321 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:51.656285 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode311bf85_9f07_4659_b745_2ca6ac4a2852.slice/crio-98c593219d402767725d7850570ceaf6e3d7ecd26e5aacf5c807871bd1f61586 WatchSource:0}: Error finding container 98c593219d402767725d7850570ceaf6e3d7ecd26e5aacf5c807871bd1f61586: Status 404 returned error can't find the container with id 98c593219d402767725d7850570ceaf6e3d7ecd26e5aacf5c807871bd1f61586 Jul 29 22:47:51.662314 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.662284 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:51.746437 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.746399 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:51.826097 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.826041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" event={"ID":"75849f87-4425-4b07-b32e-ea6df72ad69e","Type":"ContainerStarted","Data":"ee975dc4b08028cde5fe223a3724c4e9d9821f346162cb8901058f4f683194d4"} Jul 29 22:47:51.826296 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.826121 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" event={"ID":"75849f87-4425-4b07-b32e-ea6df72ad69e","Type":"ContainerStarted","Data":"e4849b0bbdeeb529cdb841825c3434825734bae031845945c801c6122aeac674"} Jul 29 22:47:51.827349 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.827319 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9k5z6" event={"ID":"e311bf85-9f07-4659-b745-2ca6ac4a2852","Type":"ContainerStarted","Data":"98c593219d402767725d7850570ceaf6e3d7ecd26e5aacf5c807871bd1f61586"} Jul 29 22:47:51.846127 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.846091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:51.849993 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.849953 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-8rkln" podStartSLOduration=2.607658218 podStartE2EDuration="3.849938118s" totalImagesPullingTime="1.2422799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:51.849125368 +0000 UTC m=+99.990696834" watchObservedRunningTime="2026-07-29 22:47:51.849938118 +0000 UTC m=+99.991509580" Jul 29 22:47:51.944586 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:51.944513 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:53.733361 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:53.733303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:53.953704 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:53.953650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:53.986069 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:53.985985 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sn5vd"] Jul 29 22:47:53.990530 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:53.990508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:53.992583 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:53.992540 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 22:47:53.992719 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:53.992607 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vdx2\"" Jul 29 22:47:53.992902 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:53.992882 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 22:47:53.992999 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:53.992927 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 22:47:54.085811 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.085775 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:54.173169 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.173133 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.173364 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.173199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/837fa36b-b207-4f25-8336-34b9a1b85d40-root\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.173364 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.173229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4s62\" (UniqueName: \"kubernetes.io/projected/837fa36b-b207-4f25-8336-34b9a1b85d40-kube-api-access-g4s62\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.173364 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.173256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-textfile\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.173364 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.173316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-accelerators-collector-config\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.173565 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.173384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-tls\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.173565 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.173444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-wtmp\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.173565 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.173528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/837fa36b-b207-4f25-8336-34b9a1b85d40-sys\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.173565 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.173558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/837fa36b-b207-4f25-8336-34b9a1b85d40-metrics-client-ca\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.174078 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.174055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:54.274637 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.274536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.274637 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.274603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/837fa36b-b207-4f25-8336-34b9a1b85d40-root\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.274637 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.274631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4s62\" (UniqueName: \"kubernetes.io/projected/837fa36b-b207-4f25-8336-34b9a1b85d40-kube-api-access-g4s62\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.274893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.274659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-textfile\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.274893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.274686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-accelerators-collector-config\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.274893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.274712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-tls\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.274893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.274744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-wtmp\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.274893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.274805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/837fa36b-b207-4f25-8336-34b9a1b85d40-sys\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.274893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.274832 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/837fa36b-b207-4f25-8336-34b9a1b85d40-metrics-client-ca\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.275550 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.275525 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/837fa36b-b207-4f25-8336-34b9a1b85d40-metrics-client-ca\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.276430 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.276405 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-accelerators-collector-config\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.276544 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.276481 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/837fa36b-b207-4f25-8336-34b9a1b85d40-root\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.276708 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.276687 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-wtmp\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.276802 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:54.276783 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 22:47:54.276868 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:54.276855 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-tls podName:837fa36b-b207-4f25-8336-34b9a1b85d40 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:54.776834591 +0000 UTC m=+102.918406045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-tls") pod "node-exporter-sn5vd" (UID: "837fa36b-b207-4f25-8336-34b9a1b85d40") : secret "node-exporter-tls" not found Jul 29 22:47:54.277387 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.276960 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-textfile\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.277387 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.277132 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/837fa36b-b207-4f25-8336-34b9a1b85d40-sys\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.277387 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.277329 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:54.281098 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.279731 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.291278 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.291255 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4s62\" (UniqueName: \"kubernetes.io/projected/837fa36b-b207-4f25-8336-34b9a1b85d40-kube-api-access-g4s62\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.423157 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.423127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:54.496963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.496931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:54.661928 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.661895 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:54.715633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.715600 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-spv92" Jul 29 22:47:54.779483 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.779458 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-tls\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.783429 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.783366 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/837fa36b-b207-4f25-8336-34b9a1b85d40-node-exporter-tls\") pod \"node-exporter-sn5vd\" (UID: \"837fa36b-b207-4f25-8336-34b9a1b85d40\") " pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.839598 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.839570 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fpl45" event={"ID":"61ac32af-4913-4663-adf4-a3daf0ce973c","Type":"ContainerStarted","Data":"8642a4a773354ec70d53df9c53f81dcfaea7365075cb231542006c10007e4298"} Jul 29 22:47:54.901445 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.901421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sn5vd" Jul 29 22:47:54.988399 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:54.988371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:55.083644 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.083559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:55.107798 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.107763 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:47:55.134644 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.134613 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:47:55.134811 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.134755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.140613 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.140234 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 22:47:55.141892 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.141866 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 22:47:55.142162 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.142146 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 22:47:55.142430 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.142415 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 22:47:55.142663 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.142645 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ftwn6\"" Jul 29 22:47:55.142845 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.142831 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 22:47:55.143065 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.143050 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 22:47:55.143496 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.143332 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 22:47:55.143496 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.143353 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 22:47:55.148379 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.148357 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 22:47:55.181943 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.181910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.181943 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.181942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.181977 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182002 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-web-config\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182351 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182351 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182351 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182501 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6p7j\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-kube-api-access-v6p7j\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182501 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.182501 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.182460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-out\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.282983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283438 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283503 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-web-config\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283605 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283672 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6p7j\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-kube-api-access-v6p7j\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283699 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-out\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283796 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283806 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.284217 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.283818 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.285272 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:55.284291 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 29 22:47:55.285272 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:47:55.284351 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-main-tls podName:6e89a3b4-fa71-4334-967d-f6aa902abdd3 nodeName:}" failed. No retries permitted until 2026-07-29 22:47:55.784331893 +0000 UTC m=+103.925903339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3") : secret "alertmanager-main-tls" not found Jul 29 22:47:55.285481 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.285458 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.287423 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.287397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-web-config\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.288205 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.288165 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.289121 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.288638 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.289121 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.288732 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-out\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.289121 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.289084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.289825 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.289685 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-volume\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.290445 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.290423 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.290951 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.290912 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.298317 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.298293 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6p7j\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-kube-api-access-v6p7j\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.300063 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.299977 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:55.492510 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.492398 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:55.694736 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.694680 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:55.789475 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.789391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.795763 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.795731 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:55.855143 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.855104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9k5z6" event={"ID":"e311bf85-9f07-4659-b745-2ca6ac4a2852","Type":"ContainerStarted","Data":"f8d4b17a9b8406cae38e68ad299f3243874b37fadb994d505602e459abbaff32"} Jul 29 22:47:55.855438 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.855418 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9k5z6" event={"ID":"e311bf85-9f07-4659-b745-2ca6ac4a2852","Type":"ContainerStarted","Data":"76a86f4a4d49c43890b583063c0e5bbd0880c962065cb474e92a0cd48699c5e6"} Jul 29 22:47:55.855570 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.855557 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9k5z6" Jul 29 22:47:55.856890 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.856864 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sn5vd" event={"ID":"837fa36b-b207-4f25-8336-34b9a1b85d40","Type":"ContainerStarted","Data":"76fd96f3beb4775e44c209baaf18cd75e68eece60ed0b021427a86291450e4f7"} Jul 29 22:47:55.880623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.880569 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9k5z6" podStartSLOduration=65.791675916 podStartE2EDuration="1m8.880554419s" totalImagesPullingTime="3.088878503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:55.87863854 +0000 UTC m=+104.020210014" watchObservedRunningTime="2026-07-29 22:47:55.880554419 +0000 UTC m=+104.022125858" Jul 29 22:47:55.884989 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:55.884961 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:56.049671 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:56.049582 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:47:56.051335 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:56.051298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:56.231432 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:56.231400 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:47:56.261368 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:56.261334 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:56.375888 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:56.375801 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e89a3b4_fa71_4334_967d_f6aa902abdd3.slice/crio-a43cf7aea7b84704d6d104f66d0ee2ee418939ad17393435b7eb90cbd5379ff2 WatchSource:0}: Error finding container a43cf7aea7b84704d6d104f66d0ee2ee418939ad17393435b7eb90cbd5379ff2: Status 404 returned error can't find the container with id a43cf7aea7b84704d6d104f66d0ee2ee418939ad17393435b7eb90cbd5379ff2 Jul 29 22:47:56.456479 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:56.456442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:56.708580 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:56.708542 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:47:56.862324 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:56.862278 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerStarted","Data":"a43cf7aea7b84704d6d104f66d0ee2ee418939ad17393435b7eb90cbd5379ff2"} Jul 29 22:47:56.863928 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:56.863899 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sn5vd" event={"ID":"837fa36b-b207-4f25-8336-34b9a1b85d40","Type":"ContainerStarted","Data":"8177070f8f758fd6a6f22fc523c919e802481c2f55cff1d435df9e0121f75dbe"} Jul 29 22:47:57.185839 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:57.185800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:57.332877 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:57.332836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:57.524392 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:57.524301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:57.717855 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:57.717822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:58.443774 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.443737 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6cc7647dd7-2f5b2"] Jul 29 22:47:58.446204 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.446175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.449336 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.449300 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 22:47:58.449336 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.449321 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 22:47:58.449336 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.449304 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7sldg\"" Jul 29 22:47:58.449578 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.449343 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 22:47:58.449578 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.449370 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8q8iqr4272s\"" Jul 29 22:47:58.449736 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.449714 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 22:47:58.458410 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.458382 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cc7647dd7-2f5b2"] Jul 29 22:47:58.515523 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.515487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvxfs\" (UniqueName: \"kubernetes.io/projected/827ecd9a-a324-4033-bc87-2c0f5689c68a-kube-api-access-kvxfs\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.515523 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.515528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/827ecd9a-a324-4033-bc87-2c0f5689c68a-metrics-server-audit-profiles\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.515770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.515552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/827ecd9a-a324-4033-bc87-2c0f5689c68a-secret-metrics-server-client-certs\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.515770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.515581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/827ecd9a-a324-4033-bc87-2c0f5689c68a-audit-log\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.515770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.515669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/827ecd9a-a324-4033-bc87-2c0f5689c68a-client-ca-bundle\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.515918 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.515775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/827ecd9a-a324-4033-bc87-2c0f5689c68a-secret-metrics-server-tls\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.515918 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.515803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827ecd9a-a324-4033-bc87-2c0f5689c68a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.616893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.616804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/827ecd9a-a324-4033-bc87-2c0f5689c68a-secret-metrics-server-tls\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.616893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.616851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827ecd9a-a324-4033-bc87-2c0f5689c68a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.617154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.616906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvxfs\" (UniqueName: \"kubernetes.io/projected/827ecd9a-a324-4033-bc87-2c0f5689c68a-kube-api-access-kvxfs\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.617154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.616936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/827ecd9a-a324-4033-bc87-2c0f5689c68a-metrics-server-audit-profiles\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.617154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.616963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/827ecd9a-a324-4033-bc87-2c0f5689c68a-secret-metrics-server-client-certs\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.617154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.616992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/827ecd9a-a324-4033-bc87-2c0f5689c68a-audit-log\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.617154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.617053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/827ecd9a-a324-4033-bc87-2c0f5689c68a-client-ca-bundle\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.617770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.617740 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827ecd9a-a324-4033-bc87-2c0f5689c68a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.617946 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.617917 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/827ecd9a-a324-4033-bc87-2c0f5689c68a-audit-log\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.618631 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.618606 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/827ecd9a-a324-4033-bc87-2c0f5689c68a-metrics-server-audit-profiles\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.620099 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.620072 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/827ecd9a-a324-4033-bc87-2c0f5689c68a-client-ca-bundle\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.620232 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.620210 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/827ecd9a-a324-4033-bc87-2c0f5689c68a-secret-metrics-server-tls\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.620274 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.620248 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/827ecd9a-a324-4033-bc87-2c0f5689c68a-secret-metrics-server-client-certs\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.628140 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.628117 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvxfs\" (UniqueName: \"kubernetes.io/projected/827ecd9a-a324-4033-bc87-2c0f5689c68a-kube-api-access-kvxfs\") pod \"metrics-server-6cc7647dd7-2f5b2\" (UID: \"827ecd9a-a324-4033-bc87-2c0f5689c68a\") " pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.757491 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.757458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:47:58.768392 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.768355 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:58.770872 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.770848 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c5f5cc688-br88b" Jul 29 22:47:58.771907 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.771884 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h"] Jul 29 22:47:58.774552 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.774534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:47:58.776937 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.776763 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8pnn7\"" Jul 29 22:47:58.776937 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.776858 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 22:47:58.792854 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.792819 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h"] Jul 29 22:47:58.818675 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.818635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4c9c\" (UniqueName: \"kubernetes.io/projected/dbf2ca77-46cc-4084-bde7-758a82b70ada-kube-api-access-s4c9c\") pod \"monitoring-plugin-68b7fc9574-55d2h\" (UID: \"dbf2ca77-46cc-4084-bde7-758a82b70ada\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:47:58.818849 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.818789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dbf2ca77-46cc-4084-bde7-758a82b70ada-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-55d2h\" (UID: \"dbf2ca77-46cc-4084-bde7-758a82b70ada\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:47:58.874849 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.874763 2578 generic.go:356] "Generic (PLEG): container finished" podID="837fa36b-b207-4f25-8336-34b9a1b85d40" containerID="8177070f8f758fd6a6f22fc523c919e802481c2f55cff1d435df9e0121f75dbe" exitCode=0 Jul 29 22:47:58.875033 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.874843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sn5vd" event={"ID":"837fa36b-b207-4f25-8336-34b9a1b85d40","Type":"ContainerDied","Data":"8177070f8f758fd6a6f22fc523c919e802481c2f55cff1d435df9e0121f75dbe"} Jul 29 22:47:58.878105 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.878033 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fpl45" event={"ID":"61ac32af-4913-4663-adf4-a3daf0ce973c","Type":"ContainerStarted","Data":"70a6f4bf5f9c7d6b0169a67d6c40ca53f8cb771448ea46e3e81166b3112c870c"} Jul 29 22:47:58.920097 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.919988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4c9c\" (UniqueName: \"kubernetes.io/projected/dbf2ca77-46cc-4084-bde7-758a82b70ada-kube-api-access-s4c9c\") pod \"monitoring-plugin-68b7fc9574-55d2h\" (UID: \"dbf2ca77-46cc-4084-bde7-758a82b70ada\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:47:58.920559 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.920325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dbf2ca77-46cc-4084-bde7-758a82b70ada-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-55d2h\" (UID: \"dbf2ca77-46cc-4084-bde7-758a82b70ada\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:47:58.923119 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.923095 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/dbf2ca77-46cc-4084-bde7-758a82b70ada-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-55d2h\" (UID: \"dbf2ca77-46cc-4084-bde7-758a82b70ada\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:47:58.929245 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.929199 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fpl45" podStartSLOduration=33.017410991 podStartE2EDuration="45.929186064s" totalImagesPullingTime="12.911775073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 22:47:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:58.927989483 +0000 UTC m=+107.069560945" watchObservedRunningTime="2026-07-29 22:47:58.929186064 +0000 UTC m=+107.070757526" Jul 29 22:47:58.935718 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.935335 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4c9c\" (UniqueName: \"kubernetes.io/projected/dbf2ca77-46cc-4084-bde7-758a82b70ada-kube-api-access-s4c9c\") pod \"monitoring-plugin-68b7fc9574-55d2h\" (UID: \"dbf2ca77-46cc-4084-bde7-758a82b70ada\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:47:58.977706 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:58.977678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:59.042271 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.042244 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cc7647dd7-2f5b2"] Jul 29 22:47:59.080022 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:59.079971 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827ecd9a_a324_4033_bc87_2c0f5689c68a.slice/crio-3363e97fc78e9c337f1ae20d961f2637722b7b05cc1c6e9909d0b0dec5a6ee3f WatchSource:0}: Error finding container 3363e97fc78e9c337f1ae20d961f2637722b7b05cc1c6e9909d0b0dec5a6ee3f: Status 404 returned error can't find the container with id 3363e97fc78e9c337f1ae20d961f2637722b7b05cc1c6e9909d0b0dec5a6ee3f Jul 29 22:47:59.094167 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.094100 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:47:59.103707 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.103684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:59.230925 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.230900 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h"] Jul 29 22:47:59.233456 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:47:59.233423 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf2ca77_46cc_4084_bde7_758a82b70ada.slice/crio-5c38f30bcd442ad88700b93682bd4b7bcfafe895b9069916986ea3cd206298ca WatchSource:0}: Error finding container 5c38f30bcd442ad88700b93682bd4b7bcfafe895b9069916986ea3cd206298ca: Status 404 returned error can't find the container with id 5c38f30bcd442ad88700b93682bd4b7bcfafe895b9069916986ea3cd206298ca Jul 29 22:47:59.396635 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.396557 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:59.499050 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.498997 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:47:59.884106 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.884038 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" event={"ID":"827ecd9a-a324-4033-bc87-2c0f5689c68a","Type":"ContainerStarted","Data":"3363e97fc78e9c337f1ae20d961f2637722b7b05cc1c6e9909d0b0dec5a6ee3f"} Jul 29 22:47:59.886430 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.886389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sn5vd" event={"ID":"837fa36b-b207-4f25-8336-34b9a1b85d40","Type":"ContainerStarted","Data":"ff411c074b50b4b46215fb5fad867398af9cabd7ad923a4c5b43b1a37262576a"} Jul 29 22:47:59.886552 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.886448 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sn5vd" event={"ID":"837fa36b-b207-4f25-8336-34b9a1b85d40","Type":"ContainerStarted","Data":"5078c771927f025bd55b3affa356cb655241f3099ef87cf6e74f9a16cb224efb"} Jul 29 22:47:59.887667 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.887641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" event={"ID":"dbf2ca77-46cc-4084-bde7-758a82b70ada","Type":"ContainerStarted","Data":"5c38f30bcd442ad88700b93682bd4b7bcfafe895b9069916986ea3cd206298ca"} Jul 29 22:47:59.889499 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.889476 2578 generic.go:356] "Generic (PLEG): container finished" podID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerID="5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885" exitCode=0 Jul 29 22:47:59.889619 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.889592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerDied","Data":"5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885"} Jul 29 22:47:59.910805 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:47:59.910747 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sn5vd" podStartSLOduration=5.349985134 podStartE2EDuration="6.910726243s" totalImagesPullingTime="1.461285245s" totalInitContainerRuntime="99.455864ms" isStatefulPod=true podCreationTimestamp="2026-07-29 22:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:47:59.907771674 +0000 UTC m=+108.049343135" watchObservedRunningTime="2026-07-29 22:47:59.910726243 +0000 UTC m=+108.052297706" Jul 29 22:48:00.379304 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:00.379206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:00.861196 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:00.861156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:00.990340 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:00.990301 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:01.466514 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.466480 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:01.557967 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.557904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:01.721611 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.721579 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" podUID="af537a17-6a0f-49a9-97d1-5e010d414432" containerName="registry" containerID="cri-o://a37d273abefcc22242bc6ff2b634dfb7d451876325c019d56cc2288b617da9ff" gracePeriod=30 Jul 29 22:48:01.797109 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.797052 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:01.899128 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.899094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:01.901359 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.901329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" event={"ID":"dbf2ca77-46cc-4084-bde7-758a82b70ada","Type":"ContainerStarted","Data":"67eb47a695d06d227264c2931627de2c02a00f6d92fe23b6800598de9e0e8410"} Jul 29 22:48:01.901922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.901874 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:48:01.906608 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.905910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerStarted","Data":"d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f"} Jul 29 22:48:01.906608 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.905987 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerStarted","Data":"9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09"} Jul 29 22:48:01.906608 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.906523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerStarted","Data":"f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea"} Jul 29 22:48:01.907390 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.907297 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" Jul 29 22:48:01.910086 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.909436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" event={"ID":"827ecd9a-a324-4033-bc87-2c0f5689c68a","Type":"ContainerStarted","Data":"2f2f79532933e734e6b4f260b088cb9c907fa70b91a7911858df73b446c9634d"} Jul 29 22:48:01.912156 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.912094 2578 generic.go:356] "Generic (PLEG): container finished" podID="af537a17-6a0f-49a9-97d1-5e010d414432" containerID="a37d273abefcc22242bc6ff2b634dfb7d451876325c019d56cc2288b617da9ff" exitCode=0 Jul 29 22:48:01.912257 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.912153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" event={"ID":"af537a17-6a0f-49a9-97d1-5e010d414432","Type":"ContainerDied","Data":"a37d273abefcc22242bc6ff2b634dfb7d451876325c019d56cc2288b617da9ff"} Jul 29 22:48:01.922890 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.922853 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-55d2h" podStartSLOduration=2.161210855 podStartE2EDuration="3.922839043s" totalImagesPullingTime="1.761628188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:01.92227949 +0000 UTC m=+110.063850953" watchObservedRunningTime="2026-07-29 22:48:01.922839043 +0000 UTC m=+110.064410505" Jul 29 22:48:01.941649 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.941596 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" podStartSLOduration=2.02765825 podStartE2EDuration="3.941574554s" totalImagesPullingTime="1.913916304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:01.940914739 +0000 UTC m=+110.082486201" watchObservedRunningTime="2026-07-29 22:48:01.941574554 +0000 UTC m=+110.083146016" Jul 29 22:48:01.973347 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:01.973284 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:48:02.050809 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.050780 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af537a17-6a0f-49a9-97d1-5e010d414432-ca-trust-extracted\") pod \"af537a17-6a0f-49a9-97d1-5e010d414432\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " Jul 29 22:48:02.051067 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.050826 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h9dz\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-kube-api-access-6h9dz\") pod \"af537a17-6a0f-49a9-97d1-5e010d414432\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " Jul 29 22:48:02.051067 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.050872 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-bound-sa-token\") pod \"af537a17-6a0f-49a9-97d1-5e010d414432\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " Jul 29 22:48:02.051067 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.050895 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") pod \"af537a17-6a0f-49a9-97d1-5e010d414432\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " Jul 29 22:48:02.051067 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.050938 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-installation-pull-secrets\") pod \"af537a17-6a0f-49a9-97d1-5e010d414432\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " Jul 29 22:48:02.051282 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.051081 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-trusted-ca\") pod \"af537a17-6a0f-49a9-97d1-5e010d414432\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " Jul 29 22:48:02.051282 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.051123 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-image-registry-private-configuration\") pod \"af537a17-6a0f-49a9-97d1-5e010d414432\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " Jul 29 22:48:02.051282 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.051161 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-registry-certificates\") pod \"af537a17-6a0f-49a9-97d1-5e010d414432\" (UID: \"af537a17-6a0f-49a9-97d1-5e010d414432\") " Jul 29 22:48:02.051619 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.051558 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "af537a17-6a0f-49a9-97d1-5e010d414432" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:02.052057 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.051985 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "af537a17-6a0f-49a9-97d1-5e010d414432" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:02.053788 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.053754 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "af537a17-6a0f-49a9-97d1-5e010d414432" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:02.053901 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.053791 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-kube-api-access-6h9dz" (OuterVolumeSpecName: "kube-api-access-6h9dz") pod "af537a17-6a0f-49a9-97d1-5e010d414432" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432"). InnerVolumeSpecName "kube-api-access-6h9dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:48:02.053901 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.053869 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "af537a17-6a0f-49a9-97d1-5e010d414432" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:48:02.053901 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.053871 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "af537a17-6a0f-49a9-97d1-5e010d414432" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:48:02.054091 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.054048 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "af537a17-6a0f-49a9-97d1-5e010d414432" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:02.062536 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.062514 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af537a17-6a0f-49a9-97d1-5e010d414432-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "af537a17-6a0f-49a9-97d1-5e010d414432" (UID: "af537a17-6a0f-49a9-97d1-5e010d414432"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:48:02.152816 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.152777 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-bound-sa-token\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:02.152816 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.152809 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-registry-tls\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:02.152816 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.152821 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-installation-pull-secrets\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:02.153084 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.152834 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-trusted-ca\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:02.153084 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.152847 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af537a17-6a0f-49a9-97d1-5e010d414432-image-registry-private-configuration\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:02.153084 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.152859 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af537a17-6a0f-49a9-97d1-5e010d414432-registry-certificates\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:02.153084 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.152870 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af537a17-6a0f-49a9-97d1-5e010d414432-ca-trust-extracted\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:02.153084 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.152881 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h9dz\" (UniqueName: \"kubernetes.io/projected/af537a17-6a0f-49a9-97d1-5e010d414432-kube-api-access-6h9dz\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:02.213671 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.213635 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:02.289879 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.289795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:02.918086 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.918040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" event={"ID":"af537a17-6a0f-49a9-97d1-5e010d414432","Type":"ContainerDied","Data":"6ad9a30003cfb5e2bb588a138fac994a8ce795be03e93f23f036f9b42b5ed9a0"} Jul 29 22:48:02.918086 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.918068 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865cc5bd4f-whfkz" Jul 29 22:48:02.918630 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.918169 2578 scope.go:117] "RemoveContainer" containerID="a37d273abefcc22242bc6ff2b634dfb7d451876325c019d56cc2288b617da9ff" Jul 29 22:48:02.922078 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.922044 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerStarted","Data":"a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906"} Jul 29 22:48:02.922219 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.922136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerStarted","Data":"78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b"} Jul 29 22:48:02.922219 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.922182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerStarted","Data":"d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359"} Jul 29 22:48:02.953841 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.953411 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.992360725 podStartE2EDuration="7.953390964s" totalImagesPullingTime="4.940615596s" totalInitContainerRuntime="20.414643ms" isStatefulPod=false podCreationTimestamp="2026-07-29 22:47:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:02.951902597 +0000 UTC m=+111.093474060" watchObservedRunningTime="2026-07-29 22:48:02.953390964 +0000 UTC m=+111.094962429" Jul 29 22:48:02.969659 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.969631 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-865cc5bd4f-whfkz"] Jul 29 22:48:02.975872 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:02.975845 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-865cc5bd4f-whfkz"] Jul 29 22:48:04.367771 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.367730 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af537a17-6a0f-49a9-97d1-5e010d414432" path="/var/lib/kubelet/pods/af537a17-6a0f-49a9-97d1-5e010d414432/volumes" Jul 29 22:48:04.670345 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.670308 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8495b6dc4c-nhblp"] Jul 29 22:48:04.670608 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.670597 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af537a17-6a0f-49a9-97d1-5e010d414432" containerName="registry" Jul 29 22:48:04.670659 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.670610 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="af537a17-6a0f-49a9-97d1-5e010d414432" containerName="registry" Jul 29 22:48:04.670704 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.670686 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="af537a17-6a0f-49a9-97d1-5e010d414432" containerName="registry" Jul 29 22:48:04.674740 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.674722 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.677178 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.677158 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 22:48:04.677856 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.677836 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 22:48:04.677856 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.677850 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jgpsf\"" Jul 29 22:48:04.677997 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.677878 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 22:48:04.677997 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.677927 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 22:48:04.677997 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.677896 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 22:48:04.677997 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.677896 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 22:48:04.678231 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.678081 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 22:48:04.683982 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.683960 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8495b6dc4c-nhblp"] Jul 29 22:48:04.777471 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.777438 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-service-ca\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.777471 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.777487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-oauth-config\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.777681 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.777507 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-oauth-serving-cert\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.777681 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.777575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67b6b\" (UniqueName: \"kubernetes.io/projected/68c65c62-b328-47fd-8cf8-c5262bf41935-kube-api-access-67b6b\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.777681 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.777638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-console-config\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.777681 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.777662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-serving-cert\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.878471 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.878432 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-service-ca\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.878471 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.878477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-oauth-config\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.878658 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.878498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-oauth-serving-cert\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.878658 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.878521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67b6b\" (UniqueName: \"kubernetes.io/projected/68c65c62-b328-47fd-8cf8-c5262bf41935-kube-api-access-67b6b\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.878658 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.878548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-console-config\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.878658 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.878576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-serving-cert\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.879270 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.879241 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-oauth-serving-cert\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.879270 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.879259 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-service-ca\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.879421 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.879276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-console-config\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.880962 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.880933 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-serving-cert\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.880962 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.880954 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-oauth-config\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.888106 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.888084 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67b6b\" (UniqueName: \"kubernetes.io/projected/68c65c62-b328-47fd-8cf8-c5262bf41935-kube-api-access-67b6b\") pod \"console-8495b6dc4c-nhblp\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:04.985476 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:04.985387 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:05.145718 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:05.145519 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8495b6dc4c-nhblp"] Jul 29 22:48:05.148509 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:48:05.148475 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c65c62_b328_47fd_8cf8_c5262bf41935.slice/crio-0961d80fee493f24f0ab88ef3507cde052aa775c4c66a097fab758339dcdddab WatchSource:0}: Error finding container 0961d80fee493f24f0ab88ef3507cde052aa775c4c66a097fab758339dcdddab: Status 404 returned error can't find the container with id 0961d80fee493f24f0ab88ef3507cde052aa775c4c66a097fab758339dcdddab Jul 29 22:48:05.866803 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:05.866768 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9k5z6" Jul 29 22:48:05.937220 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:05.937185 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8495b6dc4c-nhblp" event={"ID":"68c65c62-b328-47fd-8cf8-c5262bf41935","Type":"ContainerStarted","Data":"0961d80fee493f24f0ab88ef3507cde052aa775c4c66a097fab758339dcdddab"} Jul 29 22:48:08.897349 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:08.897310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:08.952256 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:08.952215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8495b6dc4c-nhblp" event={"ID":"68c65c62-b328-47fd-8cf8-c5262bf41935","Type":"ContainerStarted","Data":"272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc"} Jul 29 22:48:08.973054 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:08.972979 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8495b6dc4c-nhblp" podStartSLOduration=2.078362754 podStartE2EDuration="4.972961993s" totalImagesPullingTime="2.894599239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:08.971711715 +0000 UTC m=+117.113283178" watchObservedRunningTime="2026-07-29 22:48:08.972961993 +0000 UTC m=+117.114533458" Jul 29 22:48:08.997395 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:08.997356 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:09.499308 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:09.499277 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:09.636396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:09.636364 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:12.570578 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:12.570501 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:12.672612 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:12.672565 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:13.475246 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:13.475206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:13.580472 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:13.580436 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:14.208990 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:14.208950 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:14.339167 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:14.339138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:14.985861 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:14.985829 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:14.986320 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:14.986138 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:14.990726 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:14.990708 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:15.042861 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:15.042825 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:15.152460 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:15.152429 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:15.982420 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:15.982395 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:18.758437 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:18.758400 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:48:18.759065 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:18.758466 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:48:18.806598 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:18.806559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:19.491244 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:19.491212 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8495b6dc4c-nhblp"] Jul 29 22:48:21.271876 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:21.271843 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:21.360595 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:21.360556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:21.678109 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:21.678081 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:21.755456 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:21.755426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:22.231128 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:22.231092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:48:22.233572 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:22.233548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f806c44-a965-4aca-b4f7-fa89e1021afa-metrics-certs\") pod \"network-metrics-daemon-82qwh\" (UID: \"9f806c44-a965-4aca-b4f7-fa89e1021afa\") " pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:48:22.484829 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:22.484750 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4fq52\"" Jul 29 22:48:22.492053 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:22.492036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-82qwh" Jul 29 22:48:22.800032 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:22.799979 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-82qwh"] Jul 29 22:48:22.803000 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:48:22.802785 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f806c44_a965_4aca_b4f7_fa89e1021afa.slice/crio-5b4352b7847360d407ad7ffecf3f942f107d4aaf5cdad452dd06249d3be5e424 WatchSource:0}: Error finding container 5b4352b7847360d407ad7ffecf3f942f107d4aaf5cdad452dd06249d3be5e424: Status 404 returned error can't find the container with id 5b4352b7847360d407ad7ffecf3f942f107d4aaf5cdad452dd06249d3be5e424 Jul 29 22:48:23.005976 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:23.005892 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82qwh" event={"ID":"9f806c44-a965-4aca-b4f7-fa89e1021afa","Type":"ContainerStarted","Data":"5b4352b7847360d407ad7ffecf3f942f107d4aaf5cdad452dd06249d3be5e424"} Jul 29 22:48:24.322898 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:24.322878 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnww8_4ffe1740-d9c0-4cdc-82c6-67cc9ae34426/serve-healthcheck-canary/0.log" Jul 29 22:48:25.015660 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:25.015628 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82qwh" event={"ID":"9f806c44-a965-4aca-b4f7-fa89e1021afa","Type":"ContainerStarted","Data":"c40315cf03d2c3de44a63bd8c187882b1fde099b7eb3835832f0712bd411e1f0"} Jul 29 22:48:25.015862 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:25.015685 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-82qwh" event={"ID":"9f806c44-a965-4aca-b4f7-fa89e1021afa","Type":"ContainerStarted","Data":"a52e2bc17e4f2b1bae7a6090ac96496ad7250b352c1642a7f6ddb31aba9a301e"} Jul 29 22:48:25.034001 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:25.033941 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-82qwh" podStartSLOduration=131.519856754 podStartE2EDuration="2m13.03392029s" totalImagesPullingTime="1.514063536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:48:25.033125761 +0000 UTC m=+133.174697223" watchObservedRunningTime="2026-07-29 22:48:25.03392029 +0000 UTC m=+133.175491753" Jul 29 22:48:25.155311 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:25.155276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:25.233716 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:25.233685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:27.211122 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:27.211084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:27.311826 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:27.311794 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:30.035524 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:30.035489 2578 generic.go:356] "Generic (PLEG): container finished" podID="5f05580f-1566-4020-92b6-7923a0e4be5b" containerID="6bf7a733e304d38113b9aa3062c1f6170431eed99571d8f99198901f2408f7a4" exitCode=0 Jul 29 22:48:30.036088 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:30.035569 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" event={"ID":"5f05580f-1566-4020-92b6-7923a0e4be5b","Type":"ContainerDied","Data":"6bf7a733e304d38113b9aa3062c1f6170431eed99571d8f99198901f2408f7a4"} Jul 29 22:48:30.036088 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:30.035918 2578 scope.go:117] "RemoveContainer" containerID="6bf7a733e304d38113b9aa3062c1f6170431eed99571d8f99198901f2408f7a4" Jul 29 22:48:31.040606 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:31.040576 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb" event={"ID":"5f05580f-1566-4020-92b6-7923a0e4be5b","Type":"ContainerStarted","Data":"d380751ba354c4c096bc314448ebbbd5d4f6d517640a9c2ef25b927c6fbbbed6"} Jul 29 22:48:36.539453 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:36.539417 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:36.642765 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:36.642726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:36.734157 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:36.734130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:38.763830 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:38.763800 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:48:38.767799 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:38.767775 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6cc7647dd7-2f5b2" Jul 29 22:48:42.202530 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:42.202488 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:42.325130 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:42.325076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:48:44.512502 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.512463 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8495b6dc4c-nhblp" podUID="68c65c62-b328-47fd-8cf8-c5262bf41935" containerName="console" containerID="cri-o://272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc" gracePeriod=15 Jul 29 22:48:44.754109 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.754079 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:44.834767 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.834670 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-oauth-config\") pod \"68c65c62-b328-47fd-8cf8-c5262bf41935\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " Jul 29 22:48:44.834767 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.834706 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-oauth-serving-cert\") pod \"68c65c62-b328-47fd-8cf8-c5262bf41935\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " Jul 29 22:48:44.834767 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.834730 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-service-ca\") pod \"68c65c62-b328-47fd-8cf8-c5262bf41935\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " Jul 29 22:48:44.834767 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.834756 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-serving-cert\") pod \"68c65c62-b328-47fd-8cf8-c5262bf41935\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " Jul 29 22:48:44.835134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.834786 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67b6b\" (UniqueName: \"kubernetes.io/projected/68c65c62-b328-47fd-8cf8-c5262bf41935-kube-api-access-67b6b\") pod \"68c65c62-b328-47fd-8cf8-c5262bf41935\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " Jul 29 22:48:44.835134 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.834890 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-console-config\") pod \"68c65c62-b328-47fd-8cf8-c5262bf41935\" (UID: \"68c65c62-b328-47fd-8cf8-c5262bf41935\") " Jul 29 22:48:44.835233 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.835165 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "68c65c62-b328-47fd-8cf8-c5262bf41935" (UID: "68c65c62-b328-47fd-8cf8-c5262bf41935"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:44.835233 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.835210 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-service-ca" (OuterVolumeSpecName: "service-ca") pod "68c65c62-b328-47fd-8cf8-c5262bf41935" (UID: "68c65c62-b328-47fd-8cf8-c5262bf41935"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:44.835315 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.835292 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-console-config" (OuterVolumeSpecName: "console-config") pod "68c65c62-b328-47fd-8cf8-c5262bf41935" (UID: "68c65c62-b328-47fd-8cf8-c5262bf41935"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:48:44.837258 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.837236 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "68c65c62-b328-47fd-8cf8-c5262bf41935" (UID: "68c65c62-b328-47fd-8cf8-c5262bf41935"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:44.837354 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.837336 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "68c65c62-b328-47fd-8cf8-c5262bf41935" (UID: "68c65c62-b328-47fd-8cf8-c5262bf41935"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:48:44.837448 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.837431 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68c65c62-b328-47fd-8cf8-c5262bf41935-kube-api-access-67b6b" (OuterVolumeSpecName: "kube-api-access-67b6b") pod "68c65c62-b328-47fd-8cf8-c5262bf41935" (UID: "68c65c62-b328-47fd-8cf8-c5262bf41935"). InnerVolumeSpecName "kube-api-access-67b6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:48:44.935804 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.935764 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-console-config\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:44.935804 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.935799 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-oauth-config\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:44.935804 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.935809 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-oauth-serving-cert\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:44.936085 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.935821 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68c65c62-b328-47fd-8cf8-c5262bf41935-service-ca\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:44.936085 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.935830 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68c65c62-b328-47fd-8cf8-c5262bf41935-console-serving-cert\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:44.936085 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:44.935838 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67b6b\" (UniqueName: \"kubernetes.io/projected/68c65c62-b328-47fd-8cf8-c5262bf41935-kube-api-access-67b6b\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:48:45.096745 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:45.096656 2578 generic.go:356] "Generic (PLEG): container finished" podID="68c65c62-b328-47fd-8cf8-c5262bf41935" containerID="272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc" exitCode=0 Jul 29 22:48:45.096745 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:45.096706 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8495b6dc4c-nhblp" Jul 29 22:48:45.096971 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:45.096736 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8495b6dc4c-nhblp" event={"ID":"68c65c62-b328-47fd-8cf8-c5262bf41935","Type":"ContainerDied","Data":"272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc"} Jul 29 22:48:45.096971 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:45.096799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8495b6dc4c-nhblp" event={"ID":"68c65c62-b328-47fd-8cf8-c5262bf41935","Type":"ContainerDied","Data":"0961d80fee493f24f0ab88ef3507cde052aa775c4c66a097fab758339dcdddab"} Jul 29 22:48:45.096971 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:45.096826 2578 scope.go:117] "RemoveContainer" containerID="272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc" Jul 29 22:48:45.105568 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:45.105550 2578 scope.go:117] "RemoveContainer" containerID="272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc" Jul 29 22:48:45.105834 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:48:45.105812 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc\": container with ID starting with 272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc not found: ID does not exist" containerID="272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc" Jul 29 22:48:45.105905 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:45.105842 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc"} err="failed to get container status \"272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc\": rpc error: code = NotFound desc = could not find container \"272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc\": container with ID starting with 272c76143388a1eb7d7f2e6da2dcf0dbdca4311eabb465be6b0dad988411d4dc not found: ID does not exist" Jul 29 22:48:45.118729 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:45.118704 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8495b6dc4c-nhblp"] Jul 29 22:48:45.123347 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:45.123317 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8495b6dc4c-nhblp"] Jul 29 22:48:46.368575 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:46.368537 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68c65c62-b328-47fd-8cf8-c5262bf41935" path="/var/lib/kubelet/pods/68c65c62-b328-47fd-8cf8-c5262bf41935/volumes" Jul 29 22:48:50.119753 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:50.119717 2578 generic.go:356] "Generic (PLEG): container finished" podID="d5f2152b-3bf1-4fee-8e1b-3066708997fb" containerID="215369f4368b9ee338fb14d67eb4bcba3e2acff620505daac03be888ac989371" exitCode=0 Jul 29 22:48:50.120158 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:50.119787 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" event={"ID":"d5f2152b-3bf1-4fee-8e1b-3066708997fb","Type":"ContainerDied","Data":"215369f4368b9ee338fb14d67eb4bcba3e2acff620505daac03be888ac989371"} Jul 29 22:48:50.120158 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:50.120097 2578 scope.go:117] "RemoveContainer" containerID="215369f4368b9ee338fb14d67eb4bcba3e2acff620505daac03be888ac989371" Jul 29 22:48:51.126293 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:48:51.126255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-m85qj" event={"ID":"d5f2152b-3bf1-4fee-8e1b-3066708997fb","Type":"ContainerStarted","Data":"46109382f2bccb9fa6e3d1118f3ad41da743245300d1f84465b47cf890d82d44"} Jul 29 22:49:13.408759 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:13.408713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:49:13.983670 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:13.983618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:49:14.478979 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:14.478943 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:14.479400 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:14.479298 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="alertmanager" containerID="cri-o://f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea" gracePeriod=120 Jul 29 22:49:14.479400 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:14.479354 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy-metric" containerID="cri-o://78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b" gracePeriod=120 Jul 29 22:49:14.479518 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:14.479414 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy-web" containerID="cri-o://d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f" gracePeriod=120 Jul 29 22:49:14.479518 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:14.479432 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="prom-label-proxy" containerID="cri-o://a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906" gracePeriod=120 Jul 29 22:49:14.479518 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:14.479439 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy" containerID="cri-o://d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359" gracePeriod=120 Jul 29 22:49:14.479518 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:14.479454 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="config-reloader" containerID="cri-o://9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09" gracePeriod=120 Jul 29 22:49:15.219138 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.219105 2578 generic.go:356] "Generic (PLEG): container finished" podID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerID="a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906" exitCode=0 Jul 29 22:49:15.219138 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.219129 2578 generic.go:356] "Generic (PLEG): container finished" podID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerID="d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359" exitCode=0 Jul 29 22:49:15.219138 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.219136 2578 generic.go:356] "Generic (PLEG): container finished" podID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerID="9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09" exitCode=0 Jul 29 22:49:15.219138 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.219141 2578 generic.go:356] "Generic (PLEG): container finished" podID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerID="f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea" exitCode=0 Jul 29 22:49:15.219400 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.219173 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerDied","Data":"a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906"} Jul 29 22:49:15.219400 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.219239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerDied","Data":"d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359"} Jul 29 22:49:15.219400 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.219266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerDied","Data":"9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09"} Jul 29 22:49:15.219400 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.219291 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerDied","Data":"f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea"} Jul 29 22:49:15.731121 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.731096 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:15.785810 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.785720 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-web-config\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.785810 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.785763 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-volume\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.785810 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.785795 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786094 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.785847 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-tls-assets\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786094 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.785876 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-metrics-client-ca\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786094 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.785906 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6p7j\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-kube-api-access-v6p7j\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786094 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.785938 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-trusted-ca-bundle\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786094 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.785972 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-web\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786094 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.785999 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-main-tls\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786094 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.786076 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-main-db\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786438 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.786140 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-out\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786438 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.786177 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786438 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.786223 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-cluster-tls-config\") pod \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\" (UID: \"6e89a3b4-fa71-4334-967d-f6aa902abdd3\") " Jul 29 22:49:15.786748 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.786573 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:15.788552 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.787697 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:49:15.788552 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.788183 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:49:15.790734 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.790171 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-volume" (OuterVolumeSpecName: "config-volume") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:15.790734 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.790242 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:15.790734 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.790263 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:49:15.790734 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.790277 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-out" (OuterVolumeSpecName: "config-out") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:49:15.790734 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.790673 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:15.791244 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.791204 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:15.791343 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.791324 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:15.791519 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.791497 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-kube-api-access-v6p7j" (OuterVolumeSpecName: "kube-api-access-v6p7j") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "kube-api-access-v6p7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:49:15.794579 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.794557 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:15.801728 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.801698 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-web-config" (OuterVolumeSpecName: "web-config") pod "6e89a3b4-fa71-4334-967d-f6aa902abdd3" (UID: "6e89a3b4-fa71-4334-967d-f6aa902abdd3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:49:15.887428 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887392 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-cluster-tls-config\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887428 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887432 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-web-config\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887446 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-volume\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887462 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887475 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-tls-assets\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887487 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-metrics-client-ca\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887501 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6p7j\" (UniqueName: \"kubernetes.io/projected/6e89a3b4-fa71-4334-967d-f6aa902abdd3-kube-api-access-v6p7j\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887515 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887529 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887542 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-main-tls\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887556 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-alertmanager-main-db\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887568 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6e89a3b4-fa71-4334-967d-f6aa902abdd3-config-out\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:15.887623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:15.887582 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6e89a3b4-fa71-4334-967d-f6aa902abdd3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:49:16.225685 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.225647 2578 generic.go:356] "Generic (PLEG): container finished" podID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerID="78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b" exitCode=0 Jul 29 22:49:16.225685 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.225679 2578 generic.go:356] "Generic (PLEG): container finished" podID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerID="d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f" exitCode=0 Jul 29 22:49:16.225890 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.225741 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.225890 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.225735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerDied","Data":"78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b"} Jul 29 22:49:16.225957 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.225889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerDied","Data":"d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f"} Jul 29 22:49:16.225957 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.225936 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6e89a3b4-fa71-4334-967d-f6aa902abdd3","Type":"ContainerDied","Data":"a43cf7aea7b84704d6d104f66d0ee2ee418939ad17393435b7eb90cbd5379ff2"} Jul 29 22:49:16.226030 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.225953 2578 scope.go:117] "RemoveContainer" containerID="a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906" Jul 29 22:49:16.234257 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.234237 2578 scope.go:117] "RemoveContainer" containerID="78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b" Jul 29 22:49:16.242031 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.241985 2578 scope.go:117] "RemoveContainer" containerID="d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359" Jul 29 22:49:16.249577 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.249557 2578 scope.go:117] "RemoveContainer" containerID="d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f" Jul 29 22:49:16.252079 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.252051 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:16.257323 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.257298 2578 scope.go:117] "RemoveContainer" containerID="9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09" Jul 29 22:49:16.260660 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.260641 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:16.265265 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.265247 2578 scope.go:117] "RemoveContainer" containerID="f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea" Jul 29 22:49:16.272602 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.272586 2578 scope.go:117] "RemoveContainer" containerID="5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885" Jul 29 22:49:16.282139 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.282123 2578 scope.go:117] "RemoveContainer" containerID="a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906" Jul 29 22:49:16.282401 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:49:16.282382 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906\": container with ID starting with a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906 not found: ID does not exist" containerID="a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906" Jul 29 22:49:16.282467 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.282412 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906"} err="failed to get container status \"a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906\": rpc error: code = NotFound desc = could not find container \"a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906\": container with ID starting with a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906 not found: ID does not exist" Jul 29 22:49:16.282467 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.282430 2578 scope.go:117] "RemoveContainer" containerID="78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b" Jul 29 22:49:16.282665 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:49:16.282650 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b\": container with ID starting with 78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b not found: ID does not exist" containerID="78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b" Jul 29 22:49:16.282711 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.282669 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b"} err="failed to get container status \"78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b\": rpc error: code = NotFound desc = could not find container \"78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b\": container with ID starting with 78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b not found: ID does not exist" Jul 29 22:49:16.282711 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.282682 2578 scope.go:117] "RemoveContainer" containerID="d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359" Jul 29 22:49:16.282916 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:49:16.282894 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359\": container with ID starting with d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359 not found: ID does not exist" containerID="d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359" Jul 29 22:49:16.282962 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.282923 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359"} err="failed to get container status \"d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359\": rpc error: code = NotFound desc = could not find container \"d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359\": container with ID starting with d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359 not found: ID does not exist" Jul 29 22:49:16.282962 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.282939 2578 scope.go:117] "RemoveContainer" containerID="d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f" Jul 29 22:49:16.283188 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:49:16.283172 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f\": container with ID starting with d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f not found: ID does not exist" containerID="d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f" Jul 29 22:49:16.283235 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.283192 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f"} err="failed to get container status \"d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f\": rpc error: code = NotFound desc = could not find container \"d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f\": container with ID starting with d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f not found: ID does not exist" Jul 29 22:49:16.283235 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.283205 2578 scope.go:117] "RemoveContainer" containerID="9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09" Jul 29 22:49:16.283406 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:49:16.283391 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09\": container with ID starting with 9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09 not found: ID does not exist" containerID="9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09" Jul 29 22:49:16.283443 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.283409 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09"} err="failed to get container status \"9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09\": rpc error: code = NotFound desc = could not find container \"9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09\": container with ID starting with 9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09 not found: ID does not exist" Jul 29 22:49:16.283443 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.283425 2578 scope.go:117] "RemoveContainer" containerID="f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea" Jul 29 22:49:16.283624 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:49:16.283610 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea\": container with ID starting with f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea not found: ID does not exist" containerID="f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea" Jul 29 22:49:16.283660 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.283627 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea"} err="failed to get container status \"f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea\": rpc error: code = NotFound desc = could not find container \"f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea\": container with ID starting with f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea not found: ID does not exist" Jul 29 22:49:16.283660 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.283638 2578 scope.go:117] "RemoveContainer" containerID="5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885" Jul 29 22:49:16.283838 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:49:16.283821 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885\": container with ID starting with 5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885 not found: ID does not exist" containerID="5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885" Jul 29 22:49:16.283890 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.283841 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885"} err="failed to get container status \"5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885\": rpc error: code = NotFound desc = could not find container \"5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885\": container with ID starting with 5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885 not found: ID does not exist" Jul 29 22:49:16.283890 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.283854 2578 scope.go:117] "RemoveContainer" containerID="a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906" Jul 29 22:49:16.284068 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284048 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906"} err="failed to get container status \"a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906\": rpc error: code = NotFound desc = could not find container \"a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906\": container with ID starting with a643bee2ac05ea8600db6a47b7a9dd41a2b8495fc34a427b52875055f79d2906 not found: ID does not exist" Jul 29 22:49:16.284117 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284069 2578 scope.go:117] "RemoveContainer" containerID="78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b" Jul 29 22:49:16.284268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284251 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b"} err="failed to get container status \"78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b\": rpc error: code = NotFound desc = could not find container \"78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b\": container with ID starting with 78d12a69fddcc6c76167684bd8e185eca9abef9bf2007a734ed6a50022d8bb4b not found: ID does not exist" Jul 29 22:49:16.284316 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284267 2578 scope.go:117] "RemoveContainer" containerID="d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359" Jul 29 22:49:16.284443 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284429 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359"} err="failed to get container status \"d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359\": rpc error: code = NotFound desc = could not find container \"d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359\": container with ID starting with d0325e79df66f2237c58b7c05de1c89db6efbdbea0ba58bcba960bf2cebbb359 not found: ID does not exist" Jul 29 22:49:16.284486 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284443 2578 scope.go:117] "RemoveContainer" containerID="d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f" Jul 29 22:49:16.284609 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284594 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f"} err="failed to get container status \"d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f\": rpc error: code = NotFound desc = could not find container \"d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f\": container with ID starting with d4b3acf27347ddaa3bcab1807928b2c574bb27b39aaccfffe13e4eb89af4c37f not found: ID does not exist" Jul 29 22:49:16.284649 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284608 2578 scope.go:117] "RemoveContainer" containerID="9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09" Jul 29 22:49:16.284805 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284788 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09"} err="failed to get container status \"9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09\": rpc error: code = NotFound desc = could not find container \"9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09\": container with ID starting with 9ffd0d1aa4b3a92339c3591fba0f6d1ffe691d6b89b5d71659b4f2ee7d202e09 not found: ID does not exist" Jul 29 22:49:16.284847 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284804 2578 scope.go:117] "RemoveContainer" containerID="f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea" Jul 29 22:49:16.284989 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284964 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea"} err="failed to get container status \"f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea\": rpc error: code = NotFound desc = could not find container \"f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea\": container with ID starting with f4f19faf5c3edf7f7a19f40ea366e1fd5282de58cb566ecc42ee3e7bc4d25fea not found: ID does not exist" Jul 29 22:49:16.284989 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.284989 2578 scope.go:117] "RemoveContainer" containerID="5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885" Jul 29 22:49:16.285215 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.285196 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885"} err="failed to get container status \"5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885\": rpc error: code = NotFound desc = could not find container \"5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885\": container with ID starting with 5ef835142ac92a383aacdf3a7498cc11b7dfd2d2d31b373635067c1e559aa885 not found: ID does not exist" Jul 29 22:49:16.326789 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.326752 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:16.327110 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327094 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy-web" Jul 29 22:49:16.327203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327112 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy-web" Jul 29 22:49:16.327203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327123 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="init-config-reloader" Jul 29 22:49:16.327203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327131 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="init-config-reloader" Jul 29 22:49:16.327203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327141 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="config-reloader" Jul 29 22:49:16.327203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327151 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="config-reloader" Jul 29 22:49:16.327203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327169 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy-metric" Jul 29 22:49:16.327203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327178 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy-metric" Jul 29 22:49:16.327203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327186 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="prom-label-proxy" Jul 29 22:49:16.327203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327194 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="prom-label-proxy" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327208 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="alertmanager" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327217 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="alertmanager" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327235 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68c65c62-b328-47fd-8cf8-c5262bf41935" containerName="console" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327245 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="68c65c62-b328-47fd-8cf8-c5262bf41935" containerName="console" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327255 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327263 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327335 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="68c65c62-b328-47fd-8cf8-c5262bf41935" containerName="console" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327348 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy-metric" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327358 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="prom-label-proxy" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327367 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="alertmanager" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327375 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="config-reloader" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327384 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy-web" Jul 29 22:49:16.327605 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.327393 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" containerName="kube-rbac-proxy" Jul 29 22:49:16.332634 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.332613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.335049 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.335026 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 29 22:49:16.335244 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.335225 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 29 22:49:16.335346 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.335329 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 29 22:49:16.335414 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.335345 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ftwn6\"" Jul 29 22:49:16.335414 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.335360 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 29 22:49:16.335700 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.335685 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 29 22:49:16.335878 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.335865 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 29 22:49:16.336117 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.336098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 29 22:49:16.336193 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.336110 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 29 22:49:16.341132 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.341111 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 29 22:49:16.348591 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.348567 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:16.368300 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.368272 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e89a3b4-fa71-4334-967d-f6aa902abdd3" path="/var/lib/kubelet/pods/6e89a3b4-fa71-4334-967d-f6aa902abdd3/volumes" Jul 29 22:49:16.391040 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.390993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwlv\" (UniqueName: \"kubernetes.io/projected/2086005b-3ed6-48df-b147-a12512531800-kube-api-access-kkwlv\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-config-volume\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2086005b-3ed6-48df-b147-a12512531800-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2086005b-3ed6-48df-b147-a12512531800-config-out\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391322 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2086005b-3ed6-48df-b147-a12512531800-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391322 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-web-config\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391322 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2086005b-3ed6-48df-b147-a12512531800-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391322 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391238 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391322 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391322 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391304 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.391322 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.391322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2086005b-3ed6-48df-b147-a12512531800-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.491786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.491697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.491786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.491745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwlv\" (UniqueName: \"kubernetes.io/projected/2086005b-3ed6-48df-b147-a12512531800-kube-api-access-kkwlv\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492104 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.491868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-config-volume\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492104 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.491897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2086005b-3ed6-48df-b147-a12512531800-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492104 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.491920 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2086005b-3ed6-48df-b147-a12512531800-config-out\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.492125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2086005b-3ed6-48df-b147-a12512531800-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.492174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-web-config\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.492197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2086005b-3ed6-48df-b147-a12512531800-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.492239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.492269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.492297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.492338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2086005b-3ed6-48df-b147-a12512531800-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.492390 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2086005b-3ed6-48df-b147-a12512531800-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.492633 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.492431 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.493853 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.493828 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2086005b-3ed6-48df-b147-a12512531800-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.495062 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.495022 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2086005b-3ed6-48df-b147-a12512531800-config-out\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.495310 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.495277 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.495398 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.495339 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-web-config\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.495398 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.495361 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.495478 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.495425 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-config-volume\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.495594 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.495572 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.495655 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.495613 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2086005b-3ed6-48df-b147-a12512531800-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.495987 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.495962 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2086005b-3ed6-48df-b147-a12512531800-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.496922 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.496904 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.497320 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.497305 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2086005b-3ed6-48df-b147-a12512531800-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.501065 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.500983 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwlv\" (UniqueName: \"kubernetes.io/projected/2086005b-3ed6-48df-b147-a12512531800-kube-api-access-kkwlv\") pod \"alertmanager-main-0\" (UID: \"2086005b-3ed6-48df-b147-a12512531800\") " pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.642291 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.642256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 29 22:49:16.783981 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:16.783893 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 29 22:49:16.788739 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:49:16.788714 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2086005b_3ed6_48df_b147_a12512531800.slice/crio-8e488f8192e9311b03e37e217717399c2c651859b03c123b3dd4eeb43de798a1 WatchSource:0}: Error finding container 8e488f8192e9311b03e37e217717399c2c651859b03c123b3dd4eeb43de798a1: Status 404 returned error can't find the container with id 8e488f8192e9311b03e37e217717399c2c651859b03c123b3dd4eeb43de798a1 Jul 29 22:49:17.232196 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:17.232164 2578 generic.go:356] "Generic (PLEG): container finished" podID="2086005b-3ed6-48df-b147-a12512531800" containerID="105a35d97f0d6784a4723079ff4acd806b4fb3fb5310818ef8317d0a26e531ab" exitCode=0 Jul 29 22:49:17.232358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:17.232262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2086005b-3ed6-48df-b147-a12512531800","Type":"ContainerDied","Data":"105a35d97f0d6784a4723079ff4acd806b4fb3fb5310818ef8317d0a26e531ab"} Jul 29 22:49:17.232358 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:17.232340 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2086005b-3ed6-48df-b147-a12512531800","Type":"ContainerStarted","Data":"8e488f8192e9311b03e37e217717399c2c651859b03c123b3dd4eeb43de798a1"} Jul 29 22:49:18.238997 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.238959 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2086005b-3ed6-48df-b147-a12512531800","Type":"ContainerStarted","Data":"dd514095ea26fb738c121b3134e1b9285ba53c4451246f827b5270025ead0b78"} Jul 29 22:49:18.239385 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.239070 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2086005b-3ed6-48df-b147-a12512531800","Type":"ContainerStarted","Data":"b0887d83e187eb8d8a2860837d98ef0a901afa9f8716acb0a476b2a23407cb8b"} Jul 29 22:49:18.239385 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.239120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2086005b-3ed6-48df-b147-a12512531800","Type":"ContainerStarted","Data":"8827cb6374cfff83aeb1b4f8842c5cc33917a5f038ef10cf5f2fb9458f8db80d"} Jul 29 22:49:18.239385 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.239158 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2086005b-3ed6-48df-b147-a12512531800","Type":"ContainerStarted","Data":"74d0d0b9b2f733ac1670d85689ff8485a0b8b1b3f49aaea4beb20f0173e436d6"} Jul 29 22:49:18.239385 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.239193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2086005b-3ed6-48df-b147-a12512531800","Type":"ContainerStarted","Data":"99fac985ffa645eb5d4e27487d80257d5f2cb192e6f97f402bfd37a9d461b816"} Jul 29 22:49:18.239385 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.239230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2086005b-3ed6-48df-b147-a12512531800","Type":"ContainerStarted","Data":"3dc439548f74d34ad9022eb01d3d19e337453d1f797579fbc7f9c9a344a2383d"} Jul 29 22:49:18.267414 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.267364 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.253653498 podStartE2EDuration="2.267347692s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.694194ms" isStatefulPod=false podCreationTimestamp="2026-07-29 22:49:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:49:18.266517281 +0000 UTC m=+186.408088744" watchObservedRunningTime="2026-07-29 22:49:18.267347692 +0000 UTC m=+186.408919190" Jul 29 22:49:18.514722 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.514624 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-667ddd585d-5br4l"] Jul 29 22:49:18.518175 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.518150 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.520438 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.520407 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xwr5s\"" Jul 29 22:49:18.520438 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.520431 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 22:49:18.520586 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.520445 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 22:49:18.520715 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.520699 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 22:49:18.521252 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.521232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 22:49:18.521365 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.521346 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 22:49:18.529596 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.529571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 22:49:18.535617 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.535590 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-667ddd585d-5br4l"] Jul 29 22:49:18.611179 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.611129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-secret-telemeter-client\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.611394 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.611190 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.611394 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.611277 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25e08e40-9ceb-445c-836c-4df62816c1c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.611394 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.611343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-federate-client-tls\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.611532 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.611403 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25e08e40-9ceb-445c-836c-4df62816c1c3-metrics-client-ca\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.611532 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.611447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtlvh\" (UniqueName: \"kubernetes.io/projected/25e08e40-9ceb-445c-836c-4df62816c1c3-kube-api-access-rtlvh\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.611597 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.611530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25e08e40-9ceb-445c-836c-4df62816c1c3-serving-certs-ca-bundle\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.611597 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.611555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-telemeter-client-tls\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.712716 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.712670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-secret-telemeter-client\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.712716 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.712716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.713062 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.712744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25e08e40-9ceb-445c-836c-4df62816c1c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.713062 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.712783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-federate-client-tls\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.713062 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.712822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25e08e40-9ceb-445c-836c-4df62816c1c3-metrics-client-ca\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.713062 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.712849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtlvh\" (UniqueName: \"kubernetes.io/projected/25e08e40-9ceb-445c-836c-4df62816c1c3-kube-api-access-rtlvh\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.713761 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.713734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25e08e40-9ceb-445c-836c-4df62816c1c3-serving-certs-ca-bundle\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.713871 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.713773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-telemeter-client-tls\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.713871 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.713846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25e08e40-9ceb-445c-836c-4df62816c1c3-metrics-client-ca\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.713985 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.713961 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25e08e40-9ceb-445c-836c-4df62816c1c3-telemeter-trusted-ca-bundle\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.714500 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.714474 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25e08e40-9ceb-445c-836c-4df62816c1c3-serving-certs-ca-bundle\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.715832 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.715786 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-federate-client-tls\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.715937 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.715853 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-secret-telemeter-client\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.716300 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.716279 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.718487 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.718462 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/25e08e40-9ceb-445c-836c-4df62816c1c3-telemeter-client-tls\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.725108 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.725086 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtlvh\" (UniqueName: \"kubernetes.io/projected/25e08e40-9ceb-445c-836c-4df62816c1c3-kube-api-access-rtlvh\") pod \"telemeter-client-667ddd585d-5br4l\" (UID: \"25e08e40-9ceb-445c-836c-4df62816c1c3\") " pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.829688 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.829597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" Jul 29 22:49:18.993427 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:18.993395 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-667ddd585d-5br4l"] Jul 29 22:49:18.996220 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:49:18.996168 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e08e40_9ceb_445c_836c_4df62816c1c3.slice/crio-ecdbf0bde1ceb23a8afb1ad73c953f7059ce5898498085a5c7432b97b62fcca0 WatchSource:0}: Error finding container ecdbf0bde1ceb23a8afb1ad73c953f7059ce5898498085a5c7432b97b62fcca0: Status 404 returned error can't find the container with id ecdbf0bde1ceb23a8afb1ad73c953f7059ce5898498085a5c7432b97b62fcca0 Jul 29 22:49:19.245397 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:19.245363 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" event={"ID":"25e08e40-9ceb-445c-836c-4df62816c1c3","Type":"ContainerStarted","Data":"ecdbf0bde1ceb23a8afb1ad73c953f7059ce5898498085a5c7432b97b62fcca0"} Jul 29 22:49:21.255755 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:21.255722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" event={"ID":"25e08e40-9ceb-445c-836c-4df62816c1c3","Type":"ContainerStarted","Data":"3b0490a19738c1ea656619d47b4ea4928ed63204758fa7929a769d1b91d37b86"} Jul 29 22:49:21.256183 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:21.255783 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" event={"ID":"25e08e40-9ceb-445c-836c-4df62816c1c3","Type":"ContainerStarted","Data":"796bc2b94254eefded18252d60c82ee3dcba61df9a6a8eb12eded26293d3cc8b"} Jul 29 22:49:21.256183 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:21.255802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" event={"ID":"25e08e40-9ceb-445c-836c-4df62816c1c3","Type":"ContainerStarted","Data":"1ae6e583c5d8cec691f7ffb945dac1040b04ba364ea762a2595f5f6055b40eaa"} Jul 29 22:49:21.280624 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:21.280567 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-667ddd585d-5br4l" podStartSLOduration=1.470493622 podStartE2EDuration="3.280543556s" totalImagesPullingTime="1.810049934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:49:21.279798572 +0000 UTC m=+189.421370035" watchObservedRunningTime="2026-07-29 22:49:21.280543556 +0000 UTC m=+189.422115023" Jul 29 22:49:22.191662 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.191619 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f98586d49-tnjtp"] Jul 29 22:49:22.194970 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.194954 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.197317 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.197288 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 22:49:22.197447 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.197404 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 22:49:22.197516 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.197481 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 22:49:22.197695 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.197676 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 22:49:22.198037 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.198022 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 22:49:22.198125 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.198076 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 22:49:22.198277 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.198263 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 22:49:22.198364 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.198347 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jgpsf\"" Jul 29 22:49:22.207958 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.207932 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f98586d49-tnjtp"] Jul 29 22:49:22.208076 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.207957 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 22:49:22.265032 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.264979 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:49:22.343175 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.343139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:49:22.347114 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.347087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-oauth-serving-cert\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.347269 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.347196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqrzj\" (UniqueName: \"kubernetes.io/projected/7d6b8ffe-20ef-424d-908a-60c707690302-kube-api-access-pqrzj\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.347269 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.347227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-oauth-config\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.347269 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.347251 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-console-config\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.347435 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.347279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-trusted-ca-bundle\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.347435 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.347306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-serving-cert\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.347509 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.347452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-service-ca\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.448419 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.448329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqrzj\" (UniqueName: \"kubernetes.io/projected/7d6b8ffe-20ef-424d-908a-60c707690302-kube-api-access-pqrzj\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.448419 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.448369 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-oauth-config\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.448419 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.448384 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-console-config\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.448419 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.448406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-trusted-ca-bundle\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.448712 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.448429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-serving-cert\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.448712 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.448468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-service-ca\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.448712 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.448528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-oauth-serving-cert\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.449170 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.449103 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-console-config\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.449586 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.449566 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-trusted-ca-bundle\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.449770 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.449749 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-oauth-serving-cert\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.449902 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.449881 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-service-ca\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.451047 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.451024 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-oauth-config\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.451185 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.451166 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-serving-cert\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.458851 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.458825 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqrzj\" (UniqueName: \"kubernetes.io/projected/7d6b8ffe-20ef-424d-908a-60c707690302-kube-api-access-pqrzj\") pod \"console-f98586d49-tnjtp\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.504517 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.504479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:22.647824 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:22.647776 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f98586d49-tnjtp"] Jul 29 22:49:22.650976 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:49:22.650952 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6b8ffe_20ef_424d_908a_60c707690302.slice/crio-abf3a0f70135f7bfcc936c20b2dea049ca0b27c1498aec6554066a6e3d1e741e WatchSource:0}: Error finding container abf3a0f70135f7bfcc936c20b2dea049ca0b27c1498aec6554066a6e3d1e741e: Status 404 returned error can't find the container with id abf3a0f70135f7bfcc936c20b2dea049ca0b27c1498aec6554066a6e3d1e741e Jul 29 22:49:23.266430 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:23.266389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f98586d49-tnjtp" event={"ID":"7d6b8ffe-20ef-424d-908a-60c707690302","Type":"ContainerStarted","Data":"81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3"} Jul 29 22:49:23.266818 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:23.266451 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f98586d49-tnjtp" event={"ID":"7d6b8ffe-20ef-424d-908a-60c707690302","Type":"ContainerStarted","Data":"abf3a0f70135f7bfcc936c20b2dea049ca0b27c1498aec6554066a6e3d1e741e"} Jul 29 22:49:23.288908 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:23.288857 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f98586d49-tnjtp" podStartSLOduration=1.28884114 podStartE2EDuration="1.28884114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:49:23.287669998 +0000 UTC m=+191.429241460" watchObservedRunningTime="2026-07-29 22:49:23.28884114 +0000 UTC m=+191.430412602" Jul 29 22:49:32.505311 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:32.505269 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:32.505816 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:32.505342 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:32.510107 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:32.510085 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:33.315719 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:33.315691 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:49:33.489357 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:33.489324 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:49:33.591840 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:33.591748 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:49:33.679828 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:33.679799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:49:54.404097 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:54.404062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:49:54.518713 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:49:54.518677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:12.463268 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:12.463234 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:28.732917 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:28.732882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:28.814059 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:28.814028 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:34.724167 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:34.724092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:40.719950 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:40.719916 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:40.821399 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:40.821362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:45.985725 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:45.985693 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f98586d49-tnjtp"] Jul 29 22:50:46.107454 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:46.107423 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:46.207262 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:46.207226 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:46.291262 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:46.291183 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:57.191159 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:57.191123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:57.290620 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:57.290587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:50:57.610051 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:50:57.609949 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:51:11.010298 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.010223 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f98586d49-tnjtp" podUID="7d6b8ffe-20ef-424d-908a-60c707690302" containerName="console" containerID="cri-o://81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3" gracePeriod=15 Jul 29 22:51:11.259827 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.259802 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:51:11.332255 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332169 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-serving-cert\") pod \"7d6b8ffe-20ef-424d-908a-60c707690302\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " Jul 29 22:51:11.332255 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332207 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-oauth-serving-cert\") pod \"7d6b8ffe-20ef-424d-908a-60c707690302\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " Jul 29 22:51:11.332255 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332223 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-oauth-config\") pod \"7d6b8ffe-20ef-424d-908a-60c707690302\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " Jul 29 22:51:11.332255 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332244 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-console-config\") pod \"7d6b8ffe-20ef-424d-908a-60c707690302\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " Jul 29 22:51:11.332623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332361 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqrzj\" (UniqueName: \"kubernetes.io/projected/7d6b8ffe-20ef-424d-908a-60c707690302-kube-api-access-pqrzj\") pod \"7d6b8ffe-20ef-424d-908a-60c707690302\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " Jul 29 22:51:11.332623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332419 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-service-ca\") pod \"7d6b8ffe-20ef-424d-908a-60c707690302\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " Jul 29 22:51:11.332623 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332474 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-trusted-ca-bundle\") pod \"7d6b8ffe-20ef-424d-908a-60c707690302\" (UID: \"7d6b8ffe-20ef-424d-908a-60c707690302\") " Jul 29 22:51:11.332775 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332661 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7d6b8ffe-20ef-424d-908a-60c707690302" (UID: "7d6b8ffe-20ef-424d-908a-60c707690302"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:51:11.332832 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332783 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-console-config" (OuterVolumeSpecName: "console-config") pod "7d6b8ffe-20ef-424d-908a-60c707690302" (UID: "7d6b8ffe-20ef-424d-908a-60c707690302"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:51:11.332930 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.332828 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-service-ca" (OuterVolumeSpecName: "service-ca") pod "7d6b8ffe-20ef-424d-908a-60c707690302" (UID: "7d6b8ffe-20ef-424d-908a-60c707690302"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:51:11.333132 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.333086 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7d6b8ffe-20ef-424d-908a-60c707690302" (UID: "7d6b8ffe-20ef-424d-908a-60c707690302"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 22:51:11.334725 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.334697 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7d6b8ffe-20ef-424d-908a-60c707690302" (UID: "7d6b8ffe-20ef-424d-908a-60c707690302"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:51:11.334918 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.334896 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7d6b8ffe-20ef-424d-908a-60c707690302" (UID: "7d6b8ffe-20ef-424d-908a-60c707690302"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 22:51:11.334990 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.334971 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d6b8ffe-20ef-424d-908a-60c707690302-kube-api-access-pqrzj" (OuterVolumeSpecName: "kube-api-access-pqrzj") pod "7d6b8ffe-20ef-424d-908a-60c707690302" (UID: "7d6b8ffe-20ef-424d-908a-60c707690302"). InnerVolumeSpecName "kube-api-access-pqrzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:51:11.433670 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.433637 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-trusted-ca-bundle\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:51:11.433670 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.433663 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-serving-cert\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:51:11.433670 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.433673 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-oauth-serving-cert\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:51:11.433911 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.433684 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7d6b8ffe-20ef-424d-908a-60c707690302-console-oauth-config\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:51:11.433911 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.433693 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-console-config\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:51:11.433911 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.433701 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqrzj\" (UniqueName: \"kubernetes.io/projected/7d6b8ffe-20ef-424d-908a-60c707690302-kube-api-access-pqrzj\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:51:11.433911 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.433709 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7d6b8ffe-20ef-424d-908a-60c707690302-service-ca\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:51:11.681548 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.681513 2578 generic.go:356] "Generic (PLEG): container finished" podID="7d6b8ffe-20ef-424d-908a-60c707690302" containerID="81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3" exitCode=0 Jul 29 22:51:11.681808 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.681563 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f98586d49-tnjtp" Jul 29 22:51:11.681808 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.681601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f98586d49-tnjtp" event={"ID":"7d6b8ffe-20ef-424d-908a-60c707690302","Type":"ContainerDied","Data":"81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3"} Jul 29 22:51:11.681808 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.681647 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f98586d49-tnjtp" event={"ID":"7d6b8ffe-20ef-424d-908a-60c707690302","Type":"ContainerDied","Data":"abf3a0f70135f7bfcc936c20b2dea049ca0b27c1498aec6554066a6e3d1e741e"} Jul 29 22:51:11.681808 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.681669 2578 scope.go:117] "RemoveContainer" containerID="81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3" Jul 29 22:51:11.690048 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.690031 2578 scope.go:117] "RemoveContainer" containerID="81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3" Jul 29 22:51:11.690312 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:51:11.690294 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3\": container with ID starting with 81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3 not found: ID does not exist" containerID="81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3" Jul 29 22:51:11.690374 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.690324 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3"} err="failed to get container status \"81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3\": rpc error: code = NotFound desc = could not find container \"81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3\": container with ID starting with 81aaf96a8ec1375c2f9427f1ff923771db9fedc54a6359d14adff1d336db0ec3 not found: ID does not exist" Jul 29 22:51:11.703139 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.703115 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f98586d49-tnjtp"] Jul 29 22:51:11.709680 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:11.709656 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f98586d49-tnjtp"] Jul 29 22:51:12.250946 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:12.250918 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 22:51:12.368856 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:51:12.368720 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d6b8ffe-20ef-424d-908a-60c707690302" path="/var/lib/kubelet/pods/7d6b8ffe-20ef-424d-908a-60c707690302/volumes" Jul 29 22:52:06.126697 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:06.126666 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:07.786472 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:07.786442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:15.088376 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:15.088335 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:15.182341 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:15.182309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:15.480378 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:15.480350 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:15.584278 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:15.584247 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:15.667306 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:15.667270 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:16.483320 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.483288 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l"] Jul 29 22:52:16.483704 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.483604 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d6b8ffe-20ef-424d-908a-60c707690302" containerName="console" Jul 29 22:52:16.483704 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.483616 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d6b8ffe-20ef-424d-908a-60c707690302" containerName="console" Jul 29 22:52:16.483704 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.483676 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d6b8ffe-20ef-424d-908a-60c707690302" containerName="console" Jul 29 22:52:16.486636 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.486620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.488962 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.488944 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 22:52:16.489075 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.488948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77xz9\"" Jul 29 22:52:16.489579 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.489566 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 22:52:16.497487 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.497466 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l"] Jul 29 22:52:16.568906 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.568871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.569127 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.568918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.569127 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.568961 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nh4q\" (UniqueName: \"kubernetes.io/projected/0244aa32-bd32-49b4-a99b-49c10c571ca9-kube-api-access-7nh4q\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.670157 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.670120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.670157 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.670160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.670427 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.670178 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nh4q\" (UniqueName: \"kubernetes.io/projected/0244aa32-bd32-49b4-a99b-49c10c571ca9-kube-api-access-7nh4q\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.670587 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.670560 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.670650 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.670601 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.679934 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.679905 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nh4q\" (UniqueName: \"kubernetes.io/projected/0244aa32-bd32-49b4-a99b-49c10c571ca9-kube-api-access-7nh4q\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.795754 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.795666 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:16.932551 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.932530 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l"] Jul 29 22:52:16.935139 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:52:16.935115 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0244aa32_bd32_49b4_a99b_49c10c571ca9.slice/crio-0e91dd7582adce29ed625a3540ee15aeca9b41c13715309d79388524361fa526 WatchSource:0}: Error finding container 0e91dd7582adce29ed625a3540ee15aeca9b41c13715309d79388524361fa526: Status 404 returned error can't find the container with id 0e91dd7582adce29ed625a3540ee15aeca9b41c13715309d79388524361fa526 Jul 29 22:52:16.936962 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:16.936947 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 22:52:17.935676 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:17.935635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" event={"ID":"0244aa32-bd32-49b4-a99b-49c10c571ca9","Type":"ContainerStarted","Data":"0e91dd7582adce29ed625a3540ee15aeca9b41c13715309d79388524361fa526"} Jul 29 22:52:20.879918 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:20.879881 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:23.961711 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:23.961677 2578 generic.go:356] "Generic (PLEG): container finished" podID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerID="ec28165b6592ca7621e10d2301c82f1ed2a7a641512185ca566f82aa2b2578f9" exitCode=0 Jul 29 22:52:23.962132 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:23.961731 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" event={"ID":"0244aa32-bd32-49b4-a99b-49c10c571ca9","Type":"ContainerDied","Data":"ec28165b6592ca7621e10d2301c82f1ed2a7a641512185ca566f82aa2b2578f9"} Jul 29 22:52:26.982327 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:26.982282 2578 generic.go:356] "Generic (PLEG): container finished" podID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerID="4853a250ad68eed259be35b9d6e80f8c9152dcebb54b5e9d8dde248685499c5d" exitCode=0 Jul 29 22:52:26.982794 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:26.982367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" event={"ID":"0244aa32-bd32-49b4-a99b-49c10c571ca9","Type":"ContainerDied","Data":"4853a250ad68eed259be35b9d6e80f8c9152dcebb54b5e9d8dde248685499c5d"} Jul 29 22:52:35.020338 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:35.020303 2578 generic.go:356] "Generic (PLEG): container finished" podID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerID="8d93ee77d08790f9296fbbccd23c9ad8d59996103272bcf09aa46ae9a8fc16bd" exitCode=0 Jul 29 22:52:35.020712 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:35.020387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" event={"ID":"0244aa32-bd32-49b4-a99b-49c10c571ca9","Type":"ContainerDied","Data":"8d93ee77d08790f9296fbbccd23c9ad8d59996103272bcf09aa46ae9a8fc16bd"} Jul 29 22:52:36.153230 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.153201 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:36.228685 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.228651 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-bundle\") pod \"0244aa32-bd32-49b4-a99b-49c10c571ca9\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " Jul 29 22:52:36.228857 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.228697 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-util\") pod \"0244aa32-bd32-49b4-a99b-49c10c571ca9\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " Jul 29 22:52:36.228857 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.228729 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nh4q\" (UniqueName: \"kubernetes.io/projected/0244aa32-bd32-49b4-a99b-49c10c571ca9-kube-api-access-7nh4q\") pod \"0244aa32-bd32-49b4-a99b-49c10c571ca9\" (UID: \"0244aa32-bd32-49b4-a99b-49c10c571ca9\") " Jul 29 22:52:36.229355 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.229326 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-bundle" (OuterVolumeSpecName: "bundle") pod "0244aa32-bd32-49b4-a99b-49c10c571ca9" (UID: "0244aa32-bd32-49b4-a99b-49c10c571ca9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:52:36.231118 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.231092 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0244aa32-bd32-49b4-a99b-49c10c571ca9-kube-api-access-7nh4q" (OuterVolumeSpecName: "kube-api-access-7nh4q") pod "0244aa32-bd32-49b4-a99b-49c10c571ca9" (UID: "0244aa32-bd32-49b4-a99b-49c10c571ca9"). InnerVolumeSpecName "kube-api-access-7nh4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 22:52:36.232774 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.232753 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-util" (OuterVolumeSpecName: "util") pod "0244aa32-bd32-49b4-a99b-49c10c571ca9" (UID: "0244aa32-bd32-49b4-a99b-49c10c571ca9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 22:52:36.329464 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.329377 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-bundle\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:52:36.329464 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.329405 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0244aa32-bd32-49b4-a99b-49c10c571ca9-util\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:52:36.329464 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.329415 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nh4q\" (UniqueName: \"kubernetes.io/projected/0244aa32-bd32-49b4-a99b-49c10c571ca9-kube-api-access-7nh4q\") on node \"ip-10-0-133-152.ec2.internal\" DevicePath \"\"" Jul 29 22:52:36.746487 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:36.746453 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:37.029943 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:37.029858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" event={"ID":"0244aa32-bd32-49b4-a99b-49c10c571ca9","Type":"ContainerDied","Data":"0e91dd7582adce29ed625a3540ee15aeca9b41c13715309d79388524361fa526"} Jul 29 22:52:37.029943 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:37.029913 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5ms58l" Jul 29 22:52:37.030152 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:37.029915 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e91dd7582adce29ed625a3540ee15aeca9b41c13715309d79388524361fa526" Jul 29 22:52:42.949047 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:42.948993 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:43.047235 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:43.047203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:44.331575 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.331536 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8"] Jul 29 22:52:44.332074 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.331986 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerName="extract" Jul 29 22:52:44.332074 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.332024 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerName="extract" Jul 29 22:52:44.332074 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.332054 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerName="pull" Jul 29 22:52:44.332074 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.332061 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerName="pull" Jul 29 22:52:44.332074 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.332076 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerName="util" Jul 29 22:52:44.332334 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.332084 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerName="util" Jul 29 22:52:44.332334 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.332161 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0244aa32-bd32-49b4-a99b-49c10c571ca9" containerName="extract" Jul 29 22:52:44.336117 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.336096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:52:44.339392 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.339365 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 29 22:52:44.339582 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.339559 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-26frm\"" Jul 29 22:52:44.339582 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.339574 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 29 22:52:44.339711 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.339685 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 29 22:52:44.351832 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.351808 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8"] Jul 29 22:52:44.396387 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.396357 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv9cd\" (UniqueName: \"kubernetes.io/projected/61495aac-6228-464a-b157-1283dbda04d7-kube-api-access-dv9cd\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-62qj8\" (UID: \"61495aac-6228-464a-b157-1283dbda04d7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:52:44.396559 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.396396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/61495aac-6228-464a-b157-1283dbda04d7-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-62qj8\" (UID: \"61495aac-6228-464a-b157-1283dbda04d7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:52:44.497809 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.497776 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv9cd\" (UniqueName: \"kubernetes.io/projected/61495aac-6228-464a-b157-1283dbda04d7-kube-api-access-dv9cd\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-62qj8\" (UID: \"61495aac-6228-464a-b157-1283dbda04d7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:52:44.497937 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.497814 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/61495aac-6228-464a-b157-1283dbda04d7-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-62qj8\" (UID: \"61495aac-6228-464a-b157-1283dbda04d7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:52:44.500299 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.500272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/61495aac-6228-464a-b157-1283dbda04d7-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-62qj8\" (UID: \"61495aac-6228-464a-b157-1283dbda04d7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:52:44.510097 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.510075 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv9cd\" (UniqueName: \"kubernetes.io/projected/61495aac-6228-464a-b157-1283dbda04d7-kube-api-access-dv9cd\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-62qj8\" (UID: \"61495aac-6228-464a-b157-1283dbda04d7\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:52:44.646184 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.646152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:52:44.786900 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:44.786877 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8"] Jul 29 22:52:44.789838 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:52:44.789797 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61495aac_6228_464a_b157_1283dbda04d7.slice/crio-906bcecfd740a150314817babaad9885fdb560f1608ce458a18adb5188233d2d WatchSource:0}: Error finding container 906bcecfd740a150314817babaad9885fdb560f1608ce458a18adb5188233d2d: Status 404 returned error can't find the container with id 906bcecfd740a150314817babaad9885fdb560f1608ce458a18adb5188233d2d Jul 29 22:52:45.060760 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:45.060676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" event={"ID":"61495aac-6228-464a-b157-1283dbda04d7","Type":"ContainerStarted","Data":"906bcecfd740a150314817babaad9885fdb560f1608ce458a18adb5188233d2d"} Jul 29 22:52:48.076058 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:48.075952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" event={"ID":"61495aac-6228-464a-b157-1283dbda04d7","Type":"ContainerStarted","Data":"c2e5a383b427bdadb1c2f1e85d8eca3355a8066f067362eda77583c2bfa60c46"} Jul 29 22:52:48.076427 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:48.076107 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:52:48.109480 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:48.109423 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" podStartSLOduration=1.100617183 podStartE2EDuration="4.109403004s" totalImagesPullingTime="3.008785821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:52:48.108690965 +0000 UTC m=+396.250262428" watchObservedRunningTime="2026-07-29 22:52:48.109403004 +0000 UTC m=+396.250974466" Jul 29 22:52:48.250817 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:48.250787 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:48.543407 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:48.543371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:48.656677 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:48.656640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:48.870475 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:48.870381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:49.211891 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.211854 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:49.479786 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.479712 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-czhdk"] Jul 29 22:52:49.482126 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.482107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:52:49.485062 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.485035 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 29 22:52:49.485201 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.485030 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 29 22:52:49.485201 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.485160 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-t276t\"" Jul 29 22:52:49.485201 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.485161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:49.497254 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.497221 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-czhdk"] Jul 29 22:52:49.547636 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.547602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnvrd\" (UniqueName: \"kubernetes.io/projected/a219b756-295a-46b3-bece-ce29ae8a506a-kube-api-access-wnvrd\") pod \"keda-admission-56f9798bb4-czhdk\" (UID: \"a219b756-295a-46b3-bece-ce29ae8a506a\") " pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:52:49.547809 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.547665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a219b756-295a-46b3-bece-ce29ae8a506a-certificates\") pod \"keda-admission-56f9798bb4-czhdk\" (UID: \"a219b756-295a-46b3-bece-ce29ae8a506a\") " pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:52:49.592259 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.592225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:49.648888 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.648848 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnvrd\" (UniqueName: \"kubernetes.io/projected/a219b756-295a-46b3-bece-ce29ae8a506a-kube-api-access-wnvrd\") pod \"keda-admission-56f9798bb4-czhdk\" (UID: \"a219b756-295a-46b3-bece-ce29ae8a506a\") " pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:52:49.649119 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.648932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a219b756-295a-46b3-bece-ce29ae8a506a-certificates\") pod \"keda-admission-56f9798bb4-czhdk\" (UID: \"a219b756-295a-46b3-bece-ce29ae8a506a\") " pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:52:49.651977 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.651948 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/a219b756-295a-46b3-bece-ce29ae8a506a-certificates\") pod \"keda-admission-56f9798bb4-czhdk\" (UID: \"a219b756-295a-46b3-bece-ce29ae8a506a\") " pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:52:49.660488 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.660463 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnvrd\" (UniqueName: \"kubernetes.io/projected/a219b756-295a-46b3-bece-ce29ae8a506a-kube-api-access-wnvrd\") pod \"keda-admission-56f9798bb4-czhdk\" (UID: \"a219b756-295a-46b3-bece-ce29ae8a506a\") " pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:52:49.692434 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.692400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:49.792673 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.792579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:52:49.951285 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:49.951250 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-czhdk"] Jul 29 22:52:49.954568 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:52:49.954542 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda219b756_295a_46b3_bece_ce29ae8a506a.slice/crio-d416e2021fd415747d93f9620f78a6611500ae3013612f6f1121d49175eecf3b WatchSource:0}: Error finding container d416e2021fd415747d93f9620f78a6611500ae3013612f6f1121d49175eecf3b: Status 404 returned error can't find the container with id d416e2021fd415747d93f9620f78a6611500ae3013612f6f1121d49175eecf3b Jul 29 22:52:50.088431 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:50.088334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-czhdk" event={"ID":"a219b756-295a-46b3-bece-ce29ae8a506a","Type":"ContainerStarted","Data":"d416e2021fd415747d93f9620f78a6611500ae3013612f6f1121d49175eecf3b"} Jul 29 22:52:50.098948 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:50.098915 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:50.297564 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:50.297528 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:50.437779 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:50.437742 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:50.539459 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:50.539425 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:52:52.100050 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:52.099994 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-czhdk" event={"ID":"a219b756-295a-46b3-bece-ce29ae8a506a","Type":"ContainerStarted","Data":"6d2d7cd97f300cf5c8639e78805bf5328060a98870ad8e0e193b128f668e1d28"} Jul 29 22:52:52.100477 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:52.100084 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:52:52.120387 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:52:52.120339 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-czhdk" podStartSLOduration=1.697534145 podStartE2EDuration="3.12032268s" totalImagesPullingTime="1.422788535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:52:52.119177712 +0000 UTC m=+400.260749177" watchObservedRunningTime="2026-07-29 22:52:52.12032268 +0000 UTC m=+400.261894142" Jul 29 22:53:09.083379 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:53:09.083344 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-62qj8" Jul 29 22:53:13.106100 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:53:13.106073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-czhdk" Jul 29 22:53:28.403443 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:53:28.403401 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:53:44.229841 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:53:44.229749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:53:44.307567 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:53:44.307519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:08.270479 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.270443 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:08.376320 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.376287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:08.439352 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.439307 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-844cf74686-rxk7v"] Jul 29 22:54:08.442556 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.442540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:08.447744 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.447723 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 22:54:08.447893 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.447725 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-qkvpt\"" Jul 29 22:54:08.448045 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.448032 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 22:54:08.448420 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.448398 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-wxx8j"] Jul 29 22:54:08.449634 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.449605 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 29 22:54:08.452075 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.452056 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:08.454869 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.454849 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-vccq5\"" Jul 29 22:54:08.455104 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.455087 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 29 22:54:08.457724 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.457703 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-844cf74686-rxk7v"] Jul 29 22:54:08.481129 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.481095 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-wxx8j"] Jul 29 22:54:08.504594 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.504561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30c3e688-e4df-446f-bf4e-7f98f00ef69b-cert\") pod \"kserve-controller-manager-844cf74686-rxk7v\" (UID: \"30c3e688-e4df-446f-bf4e-7f98f00ef69b\") " pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:08.504754 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.504618 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5zj2\" (UniqueName: \"kubernetes.io/projected/30c3e688-e4df-446f-bf4e-7f98f00ef69b-kube-api-access-v5zj2\") pod \"kserve-controller-manager-844cf74686-rxk7v\" (UID: \"30c3e688-e4df-446f-bf4e-7f98f00ef69b\") " pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:08.524870 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.524793 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:08.605546 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.605506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5zj2\" (UniqueName: \"kubernetes.io/projected/30c3e688-e4df-446f-bf4e-7f98f00ef69b-kube-api-access-v5zj2\") pod \"kserve-controller-manager-844cf74686-rxk7v\" (UID: \"30c3e688-e4df-446f-bf4e-7f98f00ef69b\") " pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:08.605755 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.605554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gz6w\" (UniqueName: \"kubernetes.io/projected/bda37084-6d37-4a27-a536-f811191f520e-kube-api-access-7gz6w\") pod \"llmisvc-controller-manager-654c557856-wxx8j\" (UID: \"bda37084-6d37-4a27-a536-f811191f520e\") " pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:08.605755 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.605642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30c3e688-e4df-446f-bf4e-7f98f00ef69b-cert\") pod \"kserve-controller-manager-844cf74686-rxk7v\" (UID: \"30c3e688-e4df-446f-bf4e-7f98f00ef69b\") " pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:08.605755 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.605734 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bda37084-6d37-4a27-a536-f811191f520e-cert\") pod \"llmisvc-controller-manager-654c557856-wxx8j\" (UID: \"bda37084-6d37-4a27-a536-f811191f520e\") " pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:08.608270 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.608246 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30c3e688-e4df-446f-bf4e-7f98f00ef69b-cert\") pod \"kserve-controller-manager-844cf74686-rxk7v\" (UID: \"30c3e688-e4df-446f-bf4e-7f98f00ef69b\") " pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:08.614165 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.614112 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:08.616681 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.616661 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5zj2\" (UniqueName: \"kubernetes.io/projected/30c3e688-e4df-446f-bf4e-7f98f00ef69b-kube-api-access-v5zj2\") pod \"kserve-controller-manager-844cf74686-rxk7v\" (UID: \"30c3e688-e4df-446f-bf4e-7f98f00ef69b\") " pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:08.706892 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.706846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bda37084-6d37-4a27-a536-f811191f520e-cert\") pod \"llmisvc-controller-manager-654c557856-wxx8j\" (UID: \"bda37084-6d37-4a27-a536-f811191f520e\") " pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:08.707094 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.706899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gz6w\" (UniqueName: \"kubernetes.io/projected/bda37084-6d37-4a27-a536-f811191f520e-kube-api-access-7gz6w\") pod \"llmisvc-controller-manager-654c557856-wxx8j\" (UID: \"bda37084-6d37-4a27-a536-f811191f520e\") " pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:08.709487 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.709466 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bda37084-6d37-4a27-a536-f811191f520e-cert\") pod \"llmisvc-controller-manager-654c557856-wxx8j\" (UID: \"bda37084-6d37-4a27-a536-f811191f520e\") " pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:08.712850 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.712825 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:08.717697 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.717666 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gz6w\" (UniqueName: \"kubernetes.io/projected/bda37084-6d37-4a27-a536-f811191f520e-kube-api-access-7gz6w\") pod \"llmisvc-controller-manager-654c557856-wxx8j\" (UID: \"bda37084-6d37-4a27-a536-f811191f520e\") " pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:08.754560 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.754513 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:08.762798 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.762770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:08.907917 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.907761 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-844cf74686-rxk7v"] Jul 29 22:54:08.910204 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:54:08.910178 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c3e688_e4df_446f_bf4e_7f98f00ef69b.slice/crio-6492f9fa73e7296f75b4ef8f0a52656b683f08308d239bffce918767eb28f994 WatchSource:0}: Error finding container 6492f9fa73e7296f75b4ef8f0a52656b683f08308d239bffce918767eb28f994: Status 404 returned error can't find the container with id 6492f9fa73e7296f75b4ef8f0a52656b683f08308d239bffce918767eb28f994 Jul 29 22:54:08.928472 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:08.928449 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-wxx8j"] Jul 29 22:54:08.930566 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:54:08.930542 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbda37084_6d37_4a27_a536_f811191f520e.slice/crio-b21720b80bb291ec22b84ec023d09731aa23ab59d3900df401ab1994dedb7af4 WatchSource:0}: Error finding container b21720b80bb291ec22b84ec023d09731aa23ab59d3900df401ab1994dedb7af4: Status 404 returned error can't find the container with id b21720b80bb291ec22b84ec023d09731aa23ab59d3900df401ab1994dedb7af4 Jul 29 22:54:09.082708 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:09.082619 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:09.181490 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:09.181455 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:09.431809 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:09.431765 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerStarted","Data":"b21720b80bb291ec22b84ec023d09731aa23ab59d3900df401ab1994dedb7af4"} Jul 29 22:54:09.433385 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:09.433350 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-844cf74686-rxk7v" event={"ID":"30c3e688-e4df-446f-bf4e-7f98f00ef69b","Type":"ContainerStarted","Data":"6492f9fa73e7296f75b4ef8f0a52656b683f08308d239bffce918767eb28f994"} Jul 29 22:54:12.451146 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:12.451050 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-844cf74686-rxk7v" event={"ID":"30c3e688-e4df-446f-bf4e-7f98f00ef69b","Type":"ContainerStarted","Data":"981c77776246ff63a7e4c68b792a5e814e35ecf028bc77864a82bb1b590c2380"} Jul 29 22:54:12.451146 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:12.451116 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:12.452426 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:12.452401 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerStarted","Data":"78db1bea415b35573dfb5d3ba97d8fa09f4ea1be7bd1bb5dbd5e9edf3b28a7bd"} Jul 29 22:54:12.452600 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:12.452588 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:12.472226 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:12.472168 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-844cf74686-rxk7v" podStartSLOduration=1.209575712 podStartE2EDuration="4.472151525s" totalImagesPullingTime="3.262575813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:54:12.470899819 +0000 UTC m=+480.612471280" watchObservedRunningTime="2026-07-29 22:54:12.472151525 +0000 UTC m=+480.613722986" Jul 29 22:54:12.490391 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:12.490335 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podStartSLOduration=1.193849892 podStartE2EDuration="4.490318366s" totalImagesPullingTime="3.296468474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:54:12.488703719 +0000 UTC m=+480.630275202" watchObservedRunningTime="2026-07-29 22:54:12.490318366 +0000 UTC m=+480.631889827" Jul 29 22:54:13.458857 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:13.458823 2578 generic.go:356] "Generic (PLEG): container finished" podID="bda37084-6d37-4a27-a536-f811191f520e" containerID="78db1bea415b35573dfb5d3ba97d8fa09f4ea1be7bd1bb5dbd5e9edf3b28a7bd" exitCode=1 Jul 29 22:54:13.459250 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:13.458904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerDied","Data":"78db1bea415b35573dfb5d3ba97d8fa09f4ea1be7bd1bb5dbd5e9edf3b28a7bd"} Jul 29 22:54:13.459250 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:13.459099 2578 scope.go:117] "RemoveContainer" containerID="78db1bea415b35573dfb5d3ba97d8fa09f4ea1be7bd1bb5dbd5e9edf3b28a7bd" Jul 29 22:54:14.465640 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:14.465606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerStarted","Data":"c1df1015fc04e993ebbf6034ed90cb08bb994415a6467f54354aad81cbec0002"} Jul 29 22:54:14.466171 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:14.465723 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:15.472396 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:15.472361 2578 generic.go:356] "Generic (PLEG): container finished" podID="bda37084-6d37-4a27-a536-f811191f520e" containerID="c1df1015fc04e993ebbf6034ed90cb08bb994415a6467f54354aad81cbec0002" exitCode=1 Jul 29 22:54:15.472913 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:15.472440 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerDied","Data":"c1df1015fc04e993ebbf6034ed90cb08bb994415a6467f54354aad81cbec0002"} Jul 29 22:54:15.472913 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:15.472496 2578 scope.go:117] "RemoveContainer" containerID="78db1bea415b35573dfb5d3ba97d8fa09f4ea1be7bd1bb5dbd5e9edf3b28a7bd" Jul 29 22:54:15.472913 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:15.472639 2578 scope.go:117] "RemoveContainer" containerID="c1df1015fc04e993ebbf6034ed90cb08bb994415a6467f54354aad81cbec0002" Jul 29 22:54:15.472913 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:54:15.472841 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:54:16.478704 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:16.478681 2578 scope.go:117] "RemoveContainer" containerID="c1df1015fc04e993ebbf6034ed90cb08bb994415a6467f54354aad81cbec0002" Jul 29 22:54:16.479095 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:54:16.478834 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:54:18.763512 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:18.763475 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:18.764003 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:18.763983 2578 scope.go:117] "RemoveContainer" containerID="c1df1015fc04e993ebbf6034ed90cb08bb994415a6467f54354aad81cbec0002" Jul 29 22:54:18.764242 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:54:18.764218 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:54:22.194486 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.194446 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fd7c895dc-zjzmh"] Jul 29 22:54:22.199245 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.199220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.201538 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.201511 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 22:54:22.201647 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.201613 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 22:54:22.201736 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.201715 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 22:54:22.201802 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.201789 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 22:54:22.202341 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.202318 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jgpsf\"" Jul 29 22:54:22.202448 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.202361 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 22:54:22.202448 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.202404 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 22:54:22.202448 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.202361 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 22:54:22.208446 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.208430 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 22:54:22.214077 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.214057 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd7c895dc-zjzmh"] Jul 29 22:54:22.322888 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.322853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:22.330228 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.330209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-service-ca\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.330297 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.330240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-trusted-ca-bundle\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.330297 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.330256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-oauth-serving-cert\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.330366 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.330345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-console-serving-cert\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.330399 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.330370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2xg\" (UniqueName: \"kubernetes.io/projected/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-kube-api-access-gr2xg\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.330399 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.330392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-console-oauth-config\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.330500 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.330487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-console-config\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.411684 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.411644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:22.431580 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.431545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-console-config\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.431580 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.431580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-service-ca\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.431817 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.431597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-trusted-ca-bundle\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.431817 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.431615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-oauth-serving-cert\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.431817 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.431745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-console-serving-cert\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.431817 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.431774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2xg\" (UniqueName: \"kubernetes.io/projected/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-kube-api-access-gr2xg\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.431817 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.431802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-console-oauth-config\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.432389 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.432360 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-console-config\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.432389 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.432383 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-service-ca\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.432708 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.432402 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-oauth-serving-cert\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.432708 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.432674 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-trusted-ca-bundle\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.434510 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.434486 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-console-oauth-config\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.434607 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.434562 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-console-serving-cert\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.441921 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.441897 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2xg\" (UniqueName: \"kubernetes.io/projected/ec9341a7-8a31-41de-ad3f-aa526c9c14e7-kube-api-access-gr2xg\") pod \"console-6fd7c895dc-zjzmh\" (UID: \"ec9341a7-8a31-41de-ad3f-aa526c9c14e7\") " pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.509292 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.509202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:22.648933 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:22.648757 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fd7c895dc-zjzmh"] Jul 29 22:54:22.651617 ip-10-0-133-152 kubenswrapper[2578]: W0729 22:54:22.651590 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9341a7_8a31_41de_ad3f_aa526c9c14e7.slice/crio-a7cdf1d029642e3050bb550fc15078492b6cae5372d7709a498e309eaaf68952 WatchSource:0}: Error finding container a7cdf1d029642e3050bb550fc15078492b6cae5372d7709a498e309eaaf68952: Status 404 returned error can't find the container with id a7cdf1d029642e3050bb550fc15078492b6cae5372d7709a498e309eaaf68952 Jul 29 22:54:23.008241 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:23.008203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:23.507580 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:23.507545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd7c895dc-zjzmh" event={"ID":"ec9341a7-8a31-41de-ad3f-aa526c9c14e7","Type":"ContainerStarted","Data":"8ec2e448e15355643992a23210a2081d408a6bb1a2fc2b601b2dd74e35c709c7"} Jul 29 22:54:23.507963 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:23.507590 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fd7c895dc-zjzmh" event={"ID":"ec9341a7-8a31-41de-ad3f-aa526c9c14e7","Type":"ContainerStarted","Data":"a7cdf1d029642e3050bb550fc15078492b6cae5372d7709a498e309eaaf68952"} Jul 29 22:54:23.529401 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:23.529332 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fd7c895dc-zjzmh" podStartSLOduration=1.529309705 podStartE2EDuration="1.529309705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 22:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 22:54:23.528924141 +0000 UTC m=+491.670495606" watchObservedRunningTime="2026-07-29 22:54:23.529309705 +0000 UTC m=+491.670881173" Jul 29 22:54:32.366328 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:32.366296 2578 scope.go:117] "RemoveContainer" containerID="c1df1015fc04e993ebbf6034ed90cb08bb994415a6467f54354aad81cbec0002" Jul 29 22:54:32.509377 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:32.509330 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:32.509377 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:32.509387 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:32.514438 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:32.514413 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:32.549382 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:32.549344 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fd7c895dc-zjzmh" Jul 29 22:54:32.777253 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:32.777220 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:32.883073 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:32.883031 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:32.984616 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:32.984583 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:54:33.552520 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:33.552477 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerStarted","Data":"114e33785ac11f6aa29c750beab0a02e2526102e711782d4a9dcca492f3d5831"} Jul 29 22:54:33.552899 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:33.552719 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:34.558723 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:34.558688 2578 generic.go:356] "Generic (PLEG): container finished" podID="bda37084-6d37-4a27-a536-f811191f520e" containerID="114e33785ac11f6aa29c750beab0a02e2526102e711782d4a9dcca492f3d5831" exitCode=1 Jul 29 22:54:34.559201 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:34.558777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerDied","Data":"114e33785ac11f6aa29c750beab0a02e2526102e711782d4a9dcca492f3d5831"} Jul 29 22:54:34.559201 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:34.558840 2578 scope.go:117] "RemoveContainer" containerID="c1df1015fc04e993ebbf6034ed90cb08bb994415a6467f54354aad81cbec0002" Jul 29 22:54:34.559201 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:34.558944 2578 scope.go:117] "RemoveContainer" containerID="114e33785ac11f6aa29c750beab0a02e2526102e711782d4a9dcca492f3d5831" Jul 29 22:54:34.559201 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:54:34.559188 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:54:35.565047 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:35.564999 2578 scope.go:117] "RemoveContainer" containerID="114e33785ac11f6aa29c750beab0a02e2526102e711782d4a9dcca492f3d5831" Jul 29 22:54:35.565488 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:54:35.565278 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:54:38.763711 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:38.763677 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:54:38.764133 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:38.764061 2578 scope.go:117] "RemoveContainer" containerID="114e33785ac11f6aa29c750beab0a02e2526102e711782d4a9dcca492f3d5831" Jul 29 22:54:38.764236 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:54:38.764217 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:54:43.464259 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:43.464230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-844cf74686-rxk7v" Jul 29 22:54:53.363692 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:54:53.363659 2578 scope.go:117] "RemoveContainer" containerID="114e33785ac11f6aa29c750beab0a02e2526102e711782d4a9dcca492f3d5831" Jul 29 22:54:53.364163 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:54:53.363850 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:55:07.363954 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:07.363913 2578 scope.go:117] "RemoveContainer" containerID="114e33785ac11f6aa29c750beab0a02e2526102e711782d4a9dcca492f3d5831" Jul 29 22:55:08.711692 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:08.711658 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerStarted","Data":"40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe"} Jul 29 22:55:08.712126 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:08.711863 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:55:09.718154 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:09.718121 2578 generic.go:356] "Generic (PLEG): container finished" podID="bda37084-6d37-4a27-a536-f811191f520e" containerID="40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe" exitCode=1 Jul 29 22:55:09.718554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:09.718209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerDied","Data":"40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe"} Jul 29 22:55:09.718554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:09.718292 2578 scope.go:117] "RemoveContainer" containerID="114e33785ac11f6aa29c750beab0a02e2526102e711782d4a9dcca492f3d5831" Jul 29 22:55:09.718554 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:09.718549 2578 scope.go:117] "RemoveContainer" containerID="40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe" Jul 29 22:55:09.718790 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:55:09.718770 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:55:10.288726 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:10.288693 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:55:10.724541 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:10.724509 2578 scope.go:117] "RemoveContainer" containerID="40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe" Jul 29 22:55:10.724926 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:55:10.724695 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:55:18.762978 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:18.762949 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:55:18.763459 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:18.763326 2578 scope.go:117] "RemoveContainer" containerID="40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe" Jul 29 22:55:18.763519 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:55:18.763499 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:55:31.144203 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:31.144168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:55:33.113767 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:33.113731 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:55:34.364095 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:34.364064 2578 scope.go:117] "RemoveContainer" containerID="40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe" Jul 29 22:55:34.364560 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:55:34.364274 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:55:46.363969 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:46.363927 2578 scope.go:117] "RemoveContainer" containerID="40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe" Jul 29 22:55:46.364455 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:55:46.364213 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:55:58.363601 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:58.363572 2578 scope.go:117] "RemoveContainer" containerID="40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe" Jul 29 22:55:58.934698 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:58.934665 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerStarted","Data":"0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382"} Jul 29 22:55:58.934887 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:58.934872 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:55:59.940657 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:59.940573 2578 generic.go:356] "Generic (PLEG): container finished" podID="bda37084-6d37-4a27-a536-f811191f520e" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" exitCode=1 Jul 29 22:55:59.940657 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:59.940619 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerDied","Data":"0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382"} Jul 29 22:55:59.941145 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:59.940680 2578 scope.go:117] "RemoveContainer" containerID="40d01642a895b02188d0694fe8d32df1cb7b2d18e26b3fc03fd14142543c73fe" Jul 29 22:55:59.941145 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:55:59.940854 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:55:59.941145 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:55:59.941113 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:56:00.946957 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:56:00.946930 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:56:00.947354 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:56:00.947120 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:56:08.763131 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:56:08.763100 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:56:08.763648 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:56:08.763462 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:56:08.763648 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:56:08.763624 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:56:15.521280 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:56:15.521229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:56:21.363898 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:56:21.363865 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:56:21.364391 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:56:21.364100 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:56:36.363599 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:56:36.363514 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:56:36.364094 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:56:36.363712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:56:50.364093 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:56:50.364059 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:56:50.364563 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:56:50.364231 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:57:02.365428 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:02.365400 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:57:02.365902 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:57:02.365580 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:57:14.364359 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:14.364328 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:57:14.364805 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:57:14.364490 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:57:29.364277 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:29.364242 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:57:29.364766 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:29.364537 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 22:57:30.335874 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:30.335838 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerStarted","Data":"c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb"} Jul 29 22:57:30.336101 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:30.336085 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:57:31.341919 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:31.341887 2578 generic.go:356] "Generic (PLEG): container finished" podID="bda37084-6d37-4a27-a536-f811191f520e" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" exitCode=1 Jul 29 22:57:31.342390 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:31.341944 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerDied","Data":"c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb"} Jul 29 22:57:31.342390 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:31.341999 2578 scope.go:117] "RemoveContainer" containerID="0280ba5f91c3a8cb37fb8249f88c344fcd4c46c750c9e16731171ed6df8f2382" Jul 29 22:57:31.342390 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:31.342210 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:57:31.342498 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:57:31.342404 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:57:32.347849 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:32.347823 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:57:32.348347 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:57:32.348002 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:57:38.763995 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:38.763963 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 22:57:38.764574 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:38.764482 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:57:38.764732 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:57:38.764710 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:57:39.754622 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:39.754587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 22:57:54.363844 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:57:54.363810 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:57:54.364335 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:57:54.363984 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:58:06.363591 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:58:06.363558 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:58:06.364133 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:58:06.363750 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:58:21.363913 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:58:21.363873 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:58:21.364472 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:58:21.364126 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:58:35.363601 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:58:35.363567 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:58:35.364121 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:58:35.363764 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:58:46.364001 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:58:46.363963 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:58:46.364599 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:58:46.364208 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:59:01.363442 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:59:01.363407 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:59:01.363909 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:59:01.363568 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:59:16.369849 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:59:16.369818 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:59:16.370345 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:59:16.369994 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:59:31.364083 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:59:31.364044 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:59:31.364480 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:59:31.364196 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:59:42.366093 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:59:42.366060 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:59:42.366547 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:59:42.366270 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 22:59:55.363947 ip-10-0-133-152 kubenswrapper[2578]: I0729 22:59:55.363916 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 22:59:55.364369 ip-10-0-133-152 kubenswrapper[2578]: E0729 22:59:55.364078 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:00:06.364182 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:06.364143 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 23:00:06.364574 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:00:06.364402 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:00:21.363896 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:21.363864 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 23:00:23.095423 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:23.095393 2578 generic.go:356] "Generic (PLEG): container finished" podID="bda37084-6d37-4a27-a536-f811191f520e" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" exitCode=1 Jul 29 23:00:23.095844 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:23.095438 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" event={"ID":"bda37084-6d37-4a27-a536-f811191f520e","Type":"ContainerDied","Data":"54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51"} Jul 29 23:00:23.095844 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:23.095486 2578 scope.go:117] "RemoveContainer" containerID="c3898bb2f83dccbcc052fc93b81f4e6736146af553189431114b34ebfb3440cb" Jul 29 23:00:23.095844 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:23.095785 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:00:23.096002 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:00:23.095971 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:00:25.336909 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:25.336858 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 23:00:25.337378 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:25.337320 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:00:25.337505 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:00:25.337484 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:00:28.763821 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:28.763789 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" Jul 29 23:00:28.764257 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:28.764161 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:00:28.764356 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:00:28.764336 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:00:43.363884 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:43.363845 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:00:43.364386 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:00:43.364110 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:00:57.364100 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:00:57.364072 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:00:57.364575 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:00:57.364253 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:01:11.363515 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:01:11.363480 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:01:11.363937 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:01:11.363674 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:01:22.365781 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:01:22.365751 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:01:22.368343 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:01:22.365937 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:01:35.363883 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:01:35.363845 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:01:35.364468 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:01:35.364074 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:01:49.364399 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:01:49.364361 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:01:49.364854 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:01:49.364540 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:02:03.363845 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:02:03.363813 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:02:03.364326 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:02:03.363984 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:02:17.363656 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:02:17.363624 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:02:17.364105 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:02:17.363780 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:02:31.363715 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:02:31.363686 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:02:31.364135 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:02:31.363904 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:02:42.366227 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:02:42.366141 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:02:42.366737 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:02:42.366346 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:02:54.363544 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:02:54.363513 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:02:54.363945 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:02:54.363681 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:03:08.364104 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:03:08.364069 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:03:08.364485 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:03:08.364296 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:03:16.378993 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:03:16.378957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 23:03:19.363718 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:03:19.363682 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:03:19.364140 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:03:19.363888 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:03:30.364066 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:03:30.363987 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:03:30.364453 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:03:30.364267 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:03:42.370231 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:03:42.370199 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:03:42.370616 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:03:42.370405 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:03:54.364200 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:03:54.364156 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:03:54.364711 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:03:54.364386 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:04:06.364324 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:06.364289 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:04:06.364909 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:04:06.364463 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:04:14.812424 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:14.812392 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-wxx8j_bda37084-6d37-4a27-a536-f811191f520e/manager/6.log" Jul 29 23:04:17.363770 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:17.363740 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:04:17.364178 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:04:17.363917 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:04:18.750345 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:18.750310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 23:04:18.804859 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:18.804819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 23:04:28.364433 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:28.364397 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:04:28.364841 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:04:28.364624 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:04:39.299147 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:39.299097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 23:04:39.430244 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:39.430203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 23:04:39.528790 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:39.528759 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 23:04:42.102396 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:42.102356 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g4lzk_4982c15c-9467-4626-8bd8-cbce2f480236/global-pull-secret-syncer/0.log" Jul 29 23:04:42.255615 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:42.255584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" Jul 29 23:04:42.347144 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:42.347114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-152.ec2.internal_f8778c0f9386a2f70ab01d5a5201fe28/haproxy/0.log" Jul 29 23:04:42.366608 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:42.366533 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:04:42.366762 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:04:42.366743 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:04:45.206922 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:45.206883 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 23:04:45.324486 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:45.324449 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mpt4_72d39aa6-63d8-41e1-8570-1e1af6e83592/konnectivity-agent/0.log" limit=1024 Jul 29 23:04:46.741003 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:46.740971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2086005b-3ed6-48df-b147-a12512531800/alertmanager/0.log" Jul 29 23:04:46.773517 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:46.773491 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2086005b-3ed6-48df-b147-a12512531800/config-reloader/0.log" Jul 29 23:04:46.802677 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:46.802646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2086005b-3ed6-48df-b147-a12512531800/kube-rbac-proxy-web/0.log" Jul 29 23:04:46.831581 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:46.831551 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2086005b-3ed6-48df-b147-a12512531800/kube-rbac-proxy/0.log" Jul 29 23:04:46.856876 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:46.856844 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2086005b-3ed6-48df-b147-a12512531800/kube-rbac-proxy-metric/0.log" Jul 29 23:04:46.884864 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:46.884834 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2086005b-3ed6-48df-b147-a12512531800/prom-label-proxy/0.log" Jul 29 23:04:46.908980 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:46.908955 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2086005b-3ed6-48df-b147-a12512531800/init-config-reloader/0.log" Jul 29 23:04:46.958448 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:46.958413 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-595wq_bb5c2d15-2a95-46ac-b98a-e0ed5c6f104b/cluster-monitoring-operator/0.log" Jul 29 23:04:47.085466 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.085372 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6cc7647dd7-2f5b2_827ecd9a-a324-4033-bc87-2c0f5689c68a/metrics-server/0.log" Jul 29 23:04:47.122625 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.122598 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-55d2h_dbf2ca77-46cc-4084-bde7-758a82b70ada/monitoring-plugin/0.log" Jul 29 23:04:47.166177 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.166152 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sn5vd_837fa36b-b207-4f25-8336-34b9a1b85d40/node-exporter/0.log" Jul 29 23:04:47.191166 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.191132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sn5vd_837fa36b-b207-4f25-8336-34b9a1b85d40/kube-rbac-proxy/0.log" Jul 29 23:04:47.216888 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.216860 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sn5vd_837fa36b-b207-4f25-8336-34b9a1b85d40/init-textfile/0.log" Jul 29 23:04:47.698554 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.698523 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-8rkln_75849f87-4425-4b07-b32e-ea6df72ad69e/prometheus-operator/0.log" Jul 29 23:04:47.718785 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.718757 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-8rkln_75849f87-4425-4b07-b32e-ea6df72ad69e/kube-rbac-proxy/0.log" Jul 29 23:04:47.784651 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.784617 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-667ddd585d-5br4l_25e08e40-9ceb-445c-836c-4df62816c1c3/telemeter-client/0.log" Jul 29 23:04:47.810678 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.810646 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-667ddd585d-5br4l_25e08e40-9ceb-445c-836c-4df62816c1c3/reload/0.log" Jul 29 23:04:47.854108 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:47.854072 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-667ddd585d-5br4l_25e08e40-9ceb-445c-836c-4df62816c1c3/kube-rbac-proxy/0.log" Jul 29 23:04:49.317856 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:49.317825 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-74st4_ff941d05-fee4-4c44-9b88-0e1e1be6738b/networking-console-plugin/0.log" Jul 29 23:04:50.238326 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.238290 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6fd7c895dc-zjzmh_ec9341a7-8a31-41de-ad3f-aa526c9c14e7/console/0.log" Jul 29 23:04:50.550995 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.550912 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn"] Jul 29 23:04:50.554305 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.554280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.556401 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.556371 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m6zn\"/\"kube-root-ca.crt\"" Jul 29 23:04:50.556537 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.556420 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7m6zn\"/\"default-dockercfg-n77pb\"" Jul 29 23:04:50.556812 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.556798 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7m6zn\"/\"openshift-service-ca.crt\"" Jul 29 23:04:50.563275 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.563245 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn"] Jul 29 23:04:50.617281 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.617245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppvz6\" (UniqueName: \"kubernetes.io/projected/2d89d9f5-975c-47f8-a2fd-a7b572887120-kube-api-access-ppvz6\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.617281 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.617285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-lib-modules\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.617519 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.617311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-podres\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.617519 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.617348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-sys\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.617519 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.617383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-proc\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.718534 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.718497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppvz6\" (UniqueName: \"kubernetes.io/projected/2d89d9f5-975c-47f8-a2fd-a7b572887120-kube-api-access-ppvz6\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.718534 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.718541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-lib-modules\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.718766 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.718564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-podres\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.718766 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.718594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-sys\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.718766 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.718609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-proc\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.718766 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.718717 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-sys\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.718766 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.718740 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-podres\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.718766 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.718716 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-lib-modules\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.718997 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.718718 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d89d9f5-975c-47f8-a2fd-a7b572887120-proc\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.726873 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.726849 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppvz6\" (UniqueName: \"kubernetes.io/projected/2d89d9f5-975c-47f8-a2fd-a7b572887120-kube-api-access-ppvz6\") pod \"perf-node-gather-daemonset-9mhxn\" (UID: \"2d89d9f5-975c-47f8-a2fd-a7b572887120\") " pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:50.842209 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.842126 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-nsxkv_b41f0851-b749-4ca8-8311-989a6b2fc0d8/volume-data-source-validator/0.log" Jul 29 23:04:50.864922 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:50.864882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:51.003163 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:51.003130 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn"] Jul 29 23:04:51.005863 ip-10-0-133-152 kubenswrapper[2578]: W0729 23:04:51.005834 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d89d9f5_975c_47f8_a2fd_a7b572887120.slice/crio-7f9770f449223a11026b63a4e3302d68f130ca80b22e24ab2ccac0412fce959f WatchSource:0}: Error finding container 7f9770f449223a11026b63a4e3302d68f130ca80b22e24ab2ccac0412fce959f: Status 404 returned error can't find the container with id 7f9770f449223a11026b63a4e3302d68f130ca80b22e24ab2ccac0412fce959f Jul 29 23:04:51.264432 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:51.264391 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" event={"ID":"2d89d9f5-975c-47f8-a2fd-a7b572887120","Type":"ContainerStarted","Data":"a02e9fd457fc7cd336711d5c764e48a0ade1167a851124b82e4f5913b2156a42"} Jul 29 23:04:51.264619 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:51.264451 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" event={"ID":"2d89d9f5-975c-47f8-a2fd-a7b572887120","Type":"ContainerStarted","Data":"7f9770f449223a11026b63a4e3302d68f130ca80b22e24ab2ccac0412fce959f"} Jul 29 23:04:51.264619 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:51.264480 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:04:51.280259 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:51.280206 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" podStartSLOduration=1.2801839400000001 podStartE2EDuration="1.28018394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 23:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 23:04:51.279847105 +0000 UTC m=+1119.421418568" watchObservedRunningTime="2026-07-29 23:04:51.28018394 +0000 UTC m=+1119.421755401" Jul 29 23:04:51.770141 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:51.770112 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9k5z6_e311bf85-9f07-4659-b745-2ca6ac4a2852/dns/0.log" Jul 29 23:04:51.796318 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:51.796291 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9k5z6_e311bf85-9f07-4659-b745-2ca6ac4a2852/kube-rbac-proxy/0.log" Jul 29 23:04:51.936188 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:51.936158 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bsjll_89f03d30-531d-4ea5-855b-e8649825f324/dns-node-resolver/0.log" Jul 29 23:04:52.472278 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:52.472245 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c5f5cc688-br88b_8af1ac0a-4941-4084-bdc1-a26cc03f5301/registry/0.log" Jul 29 23:04:52.546058 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:52.546029 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-thx5l_441350f3-019d-46d2-a6de-9036c164e19b/node-ca/0.log" Jul 29 23:04:53.761643 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:53.761614 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnww8_4ffe1740-d9c0-4cdc-82c6-67cc9ae34426/serve-healthcheck-canary/0.log" Jul 29 23:04:54.190826 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:54.190792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fpl45_61ac32af-4913-4663-adf4-a3daf0ce973c/kube-rbac-proxy/0.log" Jul 29 23:04:54.213253 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:54.213225 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fpl45_61ac32af-4913-4663-adf4-a3daf0ce973c/exporter/0.log" Jul 29 23:04:54.239127 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:54.239094 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fpl45_61ac32af-4913-4663-adf4-a3daf0ce973c/extractor/0.log" Jul 29 23:04:54.364324 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:54.364292 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:04:54.364538 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:04:54.364513 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:04:56.693949 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:56.693917 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-844cf74686-rxk7v_30c3e688-e4df-446f-bf4e-7f98f00ef69b/manager/0.log" Jul 29 23:04:56.720477 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:56.720441 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-wxx8j_bda37084-6d37-4a27-a536-f811191f520e/manager/6.log" Jul 29 23:04:56.720477 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:56.720464 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-wxx8j_bda37084-6d37-4a27-a536-f811191f520e/manager/6.log" Jul 29 23:04:57.279684 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:04:57.279652 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7m6zn/perf-node-gather-daemonset-9mhxn" Jul 29 23:05:01.372225 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:01.372128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb_5f05580f-1566-4020-92b6-7923a0e4be5b/kube-storage-version-migrator-operator/1.log" Jul 29 23:05:01.374031 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:01.373984 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-82tjb_5f05580f-1566-4020-92b6-7923a0e4be5b/kube-storage-version-migrator-operator/0.log" Jul 29 23:05:02.330260 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:02.330221 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6tjmr_caa3926b-3b81-472c-bc79-40f5cfcdf844/kube-multus/0.log" Jul 29 23:05:02.766595 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:02.766567 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfds5_134368eb-a0bc-4dbc-aac9-8f6c4831bccd/kube-multus-additional-cni-plugins/0.log" Jul 29 23:05:02.791665 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:02.791632 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfds5_134368eb-a0bc-4dbc-aac9-8f6c4831bccd/egress-router-binary-copy/0.log" Jul 29 23:05:02.815481 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:02.815448 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfds5_134368eb-a0bc-4dbc-aac9-8f6c4831bccd/cni-plugins/0.log" Jul 29 23:05:02.841366 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:02.841326 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfds5_134368eb-a0bc-4dbc-aac9-8f6c4831bccd/bond-cni-plugin/0.log" Jul 29 23:05:02.868655 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:02.868626 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfds5_134368eb-a0bc-4dbc-aac9-8f6c4831bccd/routeoverride-cni/0.log" Jul 29 23:05:02.895745 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:02.895703 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfds5_134368eb-a0bc-4dbc-aac9-8f6c4831bccd/whereabouts-cni-bincopy/0.log" Jul 29 23:05:02.922333 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:02.922307 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zfds5_134368eb-a0bc-4dbc-aac9-8f6c4831bccd/whereabouts-cni/0.log" Jul 29 23:05:02.981724 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:02.981690 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82qwh_9f806c44-a965-4aca-b4f7-fa89e1021afa/network-metrics-daemon/0.log" Jul 29 23:05:03.003841 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:03.003810 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-82qwh_9f806c44-a965-4aca-b4f7-fa89e1021afa/kube-rbac-proxy/0.log" Jul 29 23:05:04.384888 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:04.384834 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nv5w8_873e3bef-3dfb-481c-b0f7-672fb510f13d/ovn-controller/0.log" Jul 29 23:05:04.405930 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:04.405900 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nv5w8_873e3bef-3dfb-481c-b0f7-672fb510f13d/ovn-acl-logging/0.log" Jul 29 23:05:04.433182 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:04.433149 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nv5w8_873e3bef-3dfb-481c-b0f7-672fb510f13d/kube-rbac-proxy-node/0.log" Jul 29 23:05:04.458298 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:04.458270 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nv5w8_873e3bef-3dfb-481c-b0f7-672fb510f13d/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 23:05:04.478237 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:04.478201 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nv5w8_873e3bef-3dfb-481c-b0f7-672fb510f13d/northd/0.log" Jul 29 23:05:04.501699 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:04.501665 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nv5w8_873e3bef-3dfb-481c-b0f7-672fb510f13d/nbdb/0.log" Jul 29 23:05:04.524365 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:04.524338 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nv5w8_873e3bef-3dfb-481c-b0f7-672fb510f13d/sbdb/0.log" Jul 29 23:05:04.579818 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:04.579788 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nv5w8_873e3bef-3dfb-481c-b0f7-672fb510f13d/ovnkube-controller/0.log" Jul 29 23:05:05.682080 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:05.682052 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-spv92_c429e361-e445-4d70-9d32-de7413457368/network-check-target-container/0.log" Jul 29 23:05:06.363534 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:06.363490 2578 scope.go:117] "RemoveContainer" containerID="54ff55afc6b6f3a15d75e76b0ddfdc3eee6dc1ebfdcdcb85e2186632aec7fc51" Jul 29 23:05:06.363750 ip-10-0-133-152 kubenswrapper[2578]: E0729 23:05:06.363725 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-654c557856-wxx8j_kserve(bda37084-6d37-4a27-a536-f811191f520e)\"" pod="kserve/llmisvc-controller-manager-654c557856-wxx8j" podUID="bda37084-6d37-4a27-a536-f811191f520e" Jul 29 23:05:06.666946 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:06.666920 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dpsdj_62bf8143-aead-46e4-a8f5-9c306902e46d/iptables-alerter/0.log" Jul 29 23:05:07.444687 ip-10-0-133-152 kubenswrapper[2578]: I0729 23:05:07.444657 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-v5r9p_24636425-6301-4bc4-a368-06cf02bed8e0/tuned/0.log"