Jul 06 20:24:17.552319 ip-10-0-136-213 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.055796 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061829 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061848 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061860 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061864 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061867 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061870 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061873 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:24:18.132880 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061876 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061879 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061883 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061885 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061888 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061891 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061895 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061898 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061901 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061906 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061910 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061913 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061917 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061920 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061924 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061927 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061930 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061933 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061936 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:24:18.134675 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061940 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061944 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061947 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061950 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061953 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061956 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061960 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061964 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061967 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061972 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061975 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061978 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061981 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061984 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061987 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061990 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061993 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061996 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.061999 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062002 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:24:18.135361 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062005 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062008 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062011 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062013 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062016 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062019 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062022 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062025 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062028 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062031 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062033 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062036 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062039 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062042 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062045 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062047 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062050 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062065 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062068 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062071 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:24:18.136715 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062074 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062077 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062080 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062083 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062086 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062090 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062092 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062095 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062098 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062101 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062104 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062107 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062110 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062112 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062115 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062118 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062120 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062124 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062127 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062130 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:24:18.137403 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062134 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062137 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062139 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062142 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062145 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062147 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062150 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062154 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062157 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062161 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062164 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062167 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.062170 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064119 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064131 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064136 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064140 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064144 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064176 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064205 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:24:18.138467 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064210 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064214 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064217 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064223 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064226 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064230 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064234 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064237 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064241 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064245 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064249 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064252 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064255 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064258 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064262 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064270 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064274 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064277 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064282 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:24:18.139354 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064285 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064288 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064291 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064295 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064297 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064300 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064303 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064306 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064310 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064313 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064316 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064320 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064325 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064330 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064333 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064336 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064339 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064342 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064344 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:24:18.139974 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064347 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064350 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064353 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064355 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064358 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064361 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064364 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064367 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064370 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064372 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064375 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064378 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064380 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064385 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064388 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064391 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064394 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064397 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064400 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064403 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:24:18.140568 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064406 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064409 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064412 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064414 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064417 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064420 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064423 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064426 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064429 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064432 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064435 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064438 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064441 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064444 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064446 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064449 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064451 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064454 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064457 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064459 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:24:18.141197 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064462 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064464 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064467 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064470 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064473 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064475 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064478 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064481 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064483 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064486 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064489 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064491 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064495 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064498 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064962 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064972 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064975 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064978 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064980 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064985 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:24:18.141791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064987 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064990 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064993 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064996 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.064999 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065002 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065005 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065007 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065010 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065012 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065015 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065018 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065020 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065023 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065026 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065029 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065032 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065034 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065037 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065040 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:24:18.142376 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065042 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065063 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065066 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065069 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065072 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065075 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065079 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065083 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065086 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065089 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065092 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065095 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065099 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065102 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065105 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065108 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065111 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065114 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065116 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065119 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:24:18.143014 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065122 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065125 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065127 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065130 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065132 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065135 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065138 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065140 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065143 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065145 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065148 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065151 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065153 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065156 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065161 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065165 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065170 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065175 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065178 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:24:18.143607 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065182 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065185 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065189 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065192 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065195 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065198 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065201 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065203 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065206 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065209 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065211 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065214 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065216 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065219 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065222 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065224 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065227 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065230 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065232 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065235 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:24:18.146565 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065238 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065241 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065243 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065246 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065249 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065252 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065255 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065259 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065261 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065264 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065267 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065270 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065274 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.065277 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065371 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065382 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065392 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065398 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065402 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065407 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:24:18.147266 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065412 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065417 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065420 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065423 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065427 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065431 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065434 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065438 2579 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065441 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065444 2579 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065448 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065451 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065454 2579 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065457 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065461 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065464 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065468 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065472 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065475 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065479 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065482 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065486 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065489 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065492 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:24:18.147948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065498 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065501 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065505 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065509 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065512 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065515 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065519 2579 flags.go:64] FLAG: --enable-server="true" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065522 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065528 2579 flags.go:64] FLAG: --event-burst="100" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065531 2579 flags.go:64] FLAG: --event-qps="50" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065534 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065538 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065541 2579 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065545 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065548 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065553 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065557 2579 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065560 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065563 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065566 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065569 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065572 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065576 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065579 2579 flags.go:64] FLAG: --feature-gates="" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065583 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:24:18.151185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065587 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065590 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065593 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065597 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065600 2579 flags.go:64] FLAG: --help="false" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065603 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065606 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065611 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065614 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065618 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065622 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065625 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065628 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065631 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065634 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065638 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065642 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065645 2579 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065657 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065660 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065664 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065667 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065672 2579 flags.go:64] FLAG: --lock-file="" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065675 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:24:18.152342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065678 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065681 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065688 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065691 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065694 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065697 2579 flags.go:64] FLAG: --logging-format="text" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065700 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065704 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065707 2579 flags.go:64] FLAG: --manifest-url="" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065710 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065715 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065719 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065724 2579 flags.go:64] FLAG: --max-pods="110" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065727 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065730 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065735 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065738 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065742 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065745 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065748 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065756 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065760 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065763 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:24:18.153519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065766 2579 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065769 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065776 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065780 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065783 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065786 2579 flags.go:64] FLAG: --port="10250" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065789 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065793 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08fa2486333034b99" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065798 2579 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065801 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065804 2579 flags.go:64] FLAG: --register-node="true" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065807 2579 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065811 2579 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065814 2579 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065817 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065820 2579 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065824 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065828 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065831 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065835 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065839 2579 flags.go:64] FLAG: --runonce="false" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065842 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065845 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065849 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065853 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:24:18.155408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065856 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065859 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065863 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065867 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065870 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065873 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065876 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065879 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065883 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065886 2579 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065890 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065895 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065898 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065901 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065905 2579 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065910 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065913 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065916 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065919 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065922 2579 flags.go:64] FLAG: --v="2" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065926 2579 flags.go:64] FLAG: --version="false" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065931 2579 flags.go:64] FLAG: --vmodule="" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065934 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.065938 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066077 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:24:18.156784 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066082 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066085 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066088 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066092 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066095 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066098 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066102 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066105 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066107 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066110 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066113 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066117 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066120 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066123 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066125 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066128 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066131 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066135 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066138 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066141 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:24:18.158173 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066144 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066147 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066151 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066154 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066157 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066160 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066162 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066165 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066168 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066171 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066174 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066176 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066179 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066183 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066187 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066190 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066193 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066196 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066200 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066203 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:24:18.159312 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066206 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066209 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066212 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066214 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066217 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066220 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066223 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066226 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066228 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066231 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066234 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066237 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066240 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066243 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066246 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066249 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066252 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066255 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066257 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066260 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:24:18.160238 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066263 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066265 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066268 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066271 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066273 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066276 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066279 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066282 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066286 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066290 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066295 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066298 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066301 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066304 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066307 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066311 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066314 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066317 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066319 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066322 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:24:18.164012 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066324 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066327 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066330 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066332 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066339 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066343 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066349 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066351 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066354 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066357 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066360 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066363 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066365 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066368 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066371 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066374 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066376 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:24:18.165348 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.066379 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.067291 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.095932 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.095956 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.096814 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.096825 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096897 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096904 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096908 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096912 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096918 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096924 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096927 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096931 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:24:18.166519 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096934 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096937 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096940 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096943 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096946 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096949 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096951 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096955 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096957 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096960 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096963 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096966 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096969 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096971 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096974 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096977 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096979 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096989 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096993 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096996 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:24:18.167466 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.096999 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:24:18.168200 ip-10-0-136-213 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097002 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097005 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097008 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097011 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097013 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097016 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097019 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097022 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097026 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097029 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097032 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097035 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097039 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097042 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097045 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097048 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097051 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097070 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097074 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:24:18.169431 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097077 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097080 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097084 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097087 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097089 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097092 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097095 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097098 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097101 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097103 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097106 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097109 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097113 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097116 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097119 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097122 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097125 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097127 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097130 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097133 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:24:18.170628 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097136 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097139 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097141 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097144 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097147 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097149 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097152 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097155 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097158 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097161 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097163 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097167 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097170 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097173 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097175 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097179 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097181 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097184 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097186 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097189 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:24:18.171742 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097192 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097195 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097198 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097201 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097208 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097211 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097213 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097216 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097219 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097222 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097224 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.097230 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097373 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097379 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097383 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:24:18.172479 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097386 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097389 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097392 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097395 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097398 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097408 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097411 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097414 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097417 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097421 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097425 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097427 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097431 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097435 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097438 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097440 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097443 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097446 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097449 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:24:18.173642 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097451 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097456 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097460 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097463 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097466 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097468 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097471 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097474 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097477 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097480 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097483 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097485 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097488 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097491 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097494 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097497 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097499 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097502 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097504 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097507 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:24:18.174504 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097510 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097512 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097515 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097518 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097521 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097524 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097527 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097529 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097532 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097534 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097539 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097542 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097545 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097550 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097556 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097559 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097562 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097565 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097567 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097570 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:24:18.175905 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097573 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097576 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097578 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097581 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097584 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097587 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097590 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097592 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097595 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097598 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097601 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097603 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097606 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097609 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097612 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097614 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097618 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097620 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097623 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097627 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:24:18.176611 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097630 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097634 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097636 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097639 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097643 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097647 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097651 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097654 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097657 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097660 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097663 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097665 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097668 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097671 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097674 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097677 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:24:18.257289 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:18.097680 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.097685 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.097824 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.101505 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.103139 2579 server.go:1019] "Starting client certificate rotation" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.103246 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.103282 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.107152 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.108623 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.125275 2579 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.129916 2579 log.go:25] "Validated CRI v1 image API" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.130744 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:24:18.258330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.133571 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bd36e35d-e54e-4acf-bbd4-291998a3df18:/dev/nvme0n1p4 e7a94cc6-a04b-4cc7-aecd-e7f864f6d618:/dev/nvme0n1p3] Jul 06 20:24:18.259771 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.133597 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:24:18.260400 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.141687 2579 manager.go:216] Machine: {Timestamp:2026-07-06 20:24:18.14000656 +0000 UTC m=+0.456329171 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094322 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec293c9d4cb851da19a1be5aa0ac891c SystemUUID:ec293c9d-4cb8-51da-19a1-be5aa0ac891c BootID:95a510d0-c2dd-46cc-985d-16c6d3b5c280 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fa:42:d3:86:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fa:42:d3:86:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:49:73:6f:e7:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:24:18.260400 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.141810 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:24:18.260400 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.141953 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:24:18.260400 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.146360 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:24:18.260400 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.146402 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:24:18.260400 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.148077 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:24:18.260400 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.148095 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:24:18.260400 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.148106 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.148844 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.150327 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.154014 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.154199 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.154238 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.154252 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.154268 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.154281 2579 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.154293 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.154762 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.154782 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.155688 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.157405 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.160131 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.160165 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161419 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161433 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161440 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161447 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161456 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161462 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161472 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161478 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161485 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161491 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161500 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.161508 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.162433 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.162440 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.165733 2579 server.go:1268] "Started kubelet" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.167475 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.167486 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.167554 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.170810 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.171572 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:24:18.260845 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.172743 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.173415 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-213.ec2.internal.18bfcd12d13f64cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-213.ec2.internal,UID:ip-10-0-136-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-213.ec2.internal,},FirstTimestamp:2026-07-06 20:24:18.165703884 +0000 UTC m=+0.482026493,LastTimestamp:2026-07-06 20:24:18.165703884 +0000 UTC m=+0.482026493,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-213.ec2.internal,}" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.177579 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.177621 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.178514 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.178527 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.181168 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.181244 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.181251 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.181910 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.182003 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.182109 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.182134 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.182785 2579 factory.go:55] Registering systemd factory Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.182797 2579 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.182997 2579 factory.go:153] Registering CRI-O factory Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.183004 2579 factory.go:223] Registration of the crio container factory successfully Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.183073 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.183093 2579 factory.go:103] Registering Raw factory Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.183105 2579 manager.go:1196] Started watching for new ooms in manager Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.191215 2579 manager.go:349] Starting recovery of all containers Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.191550 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jpc8r" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.192046 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.192446 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.212192 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jpc8r" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.217561 2579 manager.go:354] Recovery completed Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.222527 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.224584 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:24:18.262008 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.224617 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.224630 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.225328 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.225336 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.225341 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.225362 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.226164 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.226183 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.226195 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.235235 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-213.ec2.internal.18bfcd12d4c214a5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-213.ec2.internal,UID:ip-10-0-136-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-213.ec2.internal,},FirstTimestamp:2026-07-06 20:24:18.224600229 +0000 UTC m=+0.540922840,LastTimestamp:2026-07-06 20:24:18.224600229 +0000 UTC m=+0.540922840,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-213.ec2.internal,}" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.237312 2579 policy_none.go:49] "None policy: Start" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.237344 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.237360 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:24:18.264302 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.238502 2579 policy_none.go:47] "Start" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.281854 2579 manager.go:337] "Starting Device Plugin manager" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.281893 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.281907 2579 server.go:87] "Starting device plugin registration server" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.282223 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.282235 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.283081 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.283165 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.283174 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.283799 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.283854 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-213.ec2.internal\" not found" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.383307 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.384675 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.384713 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.384723 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:24:18.392288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.384761 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.395032 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.394149 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.395032 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.394171 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-213.ec2.internal\": node \"ip-10-0-136-213.ec2.internal\" not found" Jul 06 20:24:18.488793 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.452555 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found" Jul 06 20:24:18.488793 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.453817 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:24:18.488793 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.455238 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:24:18.488793 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.455289 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:24:18.488793 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.455321 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:24:18.488793 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.455360 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 20:24:18.488793 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.460343 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.553083 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.556513 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal"] Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.556613 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.558957 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.559003 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.559014 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.560516 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.560643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.560692 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.561402 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.561431 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.561444 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.561405 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.561509 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.561523 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.562893 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.562917 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.563597 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.563617 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:24:18.583080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.563627 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.584373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8afef05007b8d8fcc1b2b5da41446350-config\") pod \"kube-apiserver-proxy-ip-10-0-136-213.ec2.internal\" (UID: \"8afef05007b8d8fcc1b2b5da41446350\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.584401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.584421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.592866 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-213.ec2.internal\" not found" node="ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.597310 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-213.ec2.internal\" not found" node="ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.654750 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.684615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.684655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.684675 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8afef05007b8d8fcc1b2b5da41446350-config\") pod \"kube-apiserver-proxy-ip-10-0-136-213.ec2.internal\" (UID: \"8afef05007b8d8fcc1b2b5da41446350\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.684739 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.684806 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8afef05007b8d8fcc1b2b5da41446350-config\") pod \"kube-apiserver-proxy-ip-10-0-136-213.ec2.internal\" (UID: \"8afef05007b8d8fcc1b2b5da41446350\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.686833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.684843 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffb9d98d9c0e675fe807d55fcbd0e30a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal\" (UID: \"ffb9d98d9c0e675fe807d55fcbd0e30a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.756226 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.756139 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found" Jul 06 20:24:18.856284 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.856245 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found" Jul 06 20:24:18.896658 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.896630 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.900823 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:18.900662 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" Jul 06 20:24:18.956452 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:18.956409 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-213.ec2.internal\" not found" Jul 06 20:24:19.017273 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.017196 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:24:19.083066 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.083029 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" Jul 06 20:24:19.098683 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.098646 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:24:19.101950 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.101931 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" Jul 06 20:24:19.102030 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.101961 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:24:19.102124 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.102106 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:24:19.102124 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.102111 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 20:24:19.123995 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.123963 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:24:19.126402 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.126383 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:24:19.156895 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.156865 2579 apiserver.go:52] "Watching apiserver" Jul 06 20:24:19.165987 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.165958 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:24:19.167319 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.167295 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal","openshift-multus/multus-additional-cni-plugins-9j54n","openshift-multus/network-metrics-daemon-8nfpr","openshift-network-diagnostics/network-check-target-bfssb","openshift-network-operator/iptables-alerter-7h9zw","kube-system/global-pull-secret-syncer-22fms","kube-system/konnectivity-agent-75cwj","kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm","openshift-cluster-node-tuning-operator/tuned-kt8f5","openshift-image-registry/node-ca-b2phd","openshift-multus/multus-8pc8f","openshift-ovn-kubernetes/ovnkube-node-bzmx8","openshift-dns/node-resolver-r792d"] Jul 06 20:24:19.169044 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.169027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.170620 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.170603 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:19.170716 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.170682 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:19.171846 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.171825 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:24:19.171846 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.171841 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:24:19.172016 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.171953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:19.172083 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.172046 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:19.172142 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.172109 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-65zvg\"" Jul 06 20:24:19.172142 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.172124 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:24:19.172238 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.172145 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:24:19.172238 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.172114 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:24:19.173330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.173314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.174452 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.174436 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.174521 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.174489 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:19.175506 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.175487 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:19.176487 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.176470 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:24:19.176720 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.176706 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6vhrl\"" Jul 06 20:24:19.176797 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.176780 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:24:19.176878 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.176863 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.177387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.177360 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:24:19.177909 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.177884 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:24:19.178220 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.178200 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d4l4w\"" Jul 06 20:24:19.178606 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.178590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.180379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.180360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.181611 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.181590 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.182431 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.182396 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:24:19.182560 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.182399 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:24:19.182623 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.182401 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:24:19.182623 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.182587 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:24:19.182738 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.182624 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:24:19.182738 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.182644 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:24:19.182738 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.182547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f2h2t\"" Jul 06 20:24:19.182738 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.182691 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:24:19.183025 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.183002 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hjq2z\"" Jul 06 20:24:19.183256 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.183239 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.183849 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.183828 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:24:19.183849 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.183846 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:24:19.184019 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.183891 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:24:19.184019 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.183968 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sgzvl\"" Jul 06 20:24:19.184130 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.184069 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n8h2g\"" Jul 06 20:24:19.184428 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.184407 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:24:19.185163 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.185143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.185719 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.185703 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:24:19.186701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.186680 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:24:19.186801 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.186758 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:24:19.187039 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.187023 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:24:19.187254 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.187235 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:24:19.187361 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.187328 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:24:19.187429 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.187413 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-97jcw\"" Jul 06 20:24:19.187597 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.187524 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:24:19.187597 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.187578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:24:19.187714 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.187603 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mzs7x\"" Jul 06 20:24:19.188171 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-tuned\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.188279 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l8m5\" (UniqueName: \"kubernetes.io/projected/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-kube-api-access-7l8m5\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.188279 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188210 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-system-cni-dir\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.188279 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188238 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/efce9c00-b6c9-46c6-9b78-767fbb88a584-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.188436 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3da00790-e589-4a6c-8e1b-0190c41b51cb-cni-binary-copy\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.188436 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-sys\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.188436 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ghgr\" (UniqueName: \"kubernetes.io/projected/68e22029-463b-4ec1-bd53-3fb5dabcf3bb-kube-api-access-9ghgr\") pod \"iptables-alerter-7h9zw\" (UID: \"68e22029-463b-4ec1-bd53-3fb5dabcf3bb\") " pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.188436 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.188436 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188394 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-var-lib-cni-bin\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7bd04f2-db63-4ce3-8adb-87a95919989b-agent-certs\") pod \"konnectivity-agent-75cwj\" (UID: \"d7bd04f2-db63-4ce3-8adb-87a95919989b\") " pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188471 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-socket-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-conf-dir\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-tmp\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-cnibin\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188573 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f-serviceca\") pod \"node-ca-b2phd\" (UID: \"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f\") " pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188591 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-cni-dir\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-sysconfig\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l8qg\" (UniqueName: \"kubernetes.io/projected/edd25d58-7057-474b-9f09-290227d90b5b-kube-api-access-6l8qg\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.188695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-kubernetes\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-kubelet-config\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188744 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-host\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188763 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-hostroot\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188778 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-sysctl-d\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-os-release\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188821 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-socket-dir-parent\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-run-multus-certs\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188857 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188872 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-sysctl-conf\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8stnt\" (UniqueName: \"kubernetes.io/projected/cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f-kube-api-access-8stnt\") pod \"node-ca-b2phd\" (UID: \"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f\") " pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-cnibin\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188942 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f-host\") pod \"node-ca-b2phd\" (UID: \"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f\") " pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.188970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-registration-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.189345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189010 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-modprobe-d\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk7jg\" (UniqueName: \"kubernetes.io/projected/b559bb74-1c48-40b3-969e-020253e57e45-kube-api-access-zk7jg\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189060 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25czq\" (UniqueName: \"kubernetes.io/projected/3da00790-e589-4a6c-8e1b-0190c41b51cb-kube-api-access-25czq\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68e22029-463b-4ec1-bd53-3fb5dabcf3bb-host-slash\") pod \"iptables-alerter-7h9zw\" (UID: \"68e22029-463b-4ec1-bd53-3fb5dabcf3bb\") " pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zsjz\" (UniqueName: \"kubernetes.io/projected/efce9c00-b6c9-46c6-9b78-767fbb88a584-kube-api-access-4zsjz\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/efce9c00-b6c9-46c6-9b78-767fbb88a584-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-run\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-dbus\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-device-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189209 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-systemd\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189225 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-var-lib-cni-multus\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-var-lib-kubelet\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-sys-fs\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.190047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7bd04f2-db63-4ce3-8adb-87a95919989b-konnectivity-ca\") pod \"konnectivity-agent-75cwj\" (UID: \"d7bd04f2-db63-4ce3-8adb-87a95919989b\") " pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-os-release\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189322 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-system-cni-dir\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189342 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-run-netns\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-var-lib-kubelet\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-run-k8s-cni-cncf-io\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-etc-kubernetes\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68e22029-463b-4ec1-bd53-3fb5dabcf3bb-iptables-alerter-script\") pod \"iptables-alerter-7h9zw\" (UID: \"68e22029-463b-4ec1-bd53-3fb5dabcf3bb\") " pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-lib-modules\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189473 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efce9c00-b6c9-46c6-9b78-767fbb88a584-cni-binary-copy\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:19.190701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.189504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-daemon-config\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.194850 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.194831 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:24:19.238043 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.237993 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:19:19 +0000 UTC" deadline="2028-04-10 06:29:48.373781242 +0000 UTC" Jul 06 20:24:19.238043 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.238040 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15442h5m29.135743378s" Jul 06 20:24:19.282344 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.282280 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:24:19.289674 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-node-log\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.289803 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-cni-netd\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.289803 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/efce9c00-b6c9-46c6-9b78-767fbb88a584-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.289803 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289797 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-systemd-units\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.289993 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289822 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-run-netns\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.289993 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a4e538e-cd87-4383-b937-ad0a9ca86f10-ovn-node-metrics-cert\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.289993 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-run\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.289993 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-dbus\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.289993 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-device-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.289993 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.289987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-systemd\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-var-lib-cni-multus\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-var-lib-kubelet\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-device-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a4e538e-cd87-4383-b937-ad0a9ca86f10-env-overrides\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290011 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-run\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290101 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-var-lib-cni-multus\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290104 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-dbus\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290140 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-systemd\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290159 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-var-lib-kubelet\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-sys-fs\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290210 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7bd04f2-db63-4ce3-8adb-87a95919989b-konnectivity-ca\") pod \"konnectivity-agent-75cwj\" (UID: \"d7bd04f2-db63-4ce3-8adb-87a95919989b\") " pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-os-release\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290247 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-sys-fs\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-system-cni-dir\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.290379 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290374 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-run-netns\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290394 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/efce9c00-b6c9-46c6-9b78-767fbb88a584-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290407 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-os-release\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290376 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-system-cni-dir\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290410 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-run-netns\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-etc-openvswitch\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-cni-bin\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52d8bc32-2d42-49fb-9a90-d7403c5e6766-tmp-dir\") pod \"node-resolver-r792d\" (UID: \"52d8bc32-2d42-49fb-9a90-d7403c5e6766\") " pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-var-lib-kubelet\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290532 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-run-k8s-cni-cncf-io\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290560 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-etc-kubernetes\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290577 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-run-k8s-cni-cncf-io\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290586 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-var-lib-kubelet\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-kubelet\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.291150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290624 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-etc-kubernetes\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-var-lib-openvswitch\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a4e538e-cd87-4383-b937-ad0a9ca86f10-ovnkube-script-lib\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68e22029-463b-4ec1-bd53-3fb5dabcf3bb-iptables-alerter-script\") pod \"iptables-alerter-7h9zw\" (UID: \"68e22029-463b-4ec1-bd53-3fb5dabcf3bb\") " pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-lib-modules\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290733 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7bd04f2-db63-4ce3-8adb-87a95919989b-konnectivity-ca\") pod \"konnectivity-agent-75cwj\" (UID: \"d7bd04f2-db63-4ce3-8adb-87a95919989b\") " pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efce9c00-b6c9-46c6-9b78-767fbb88a584-cni-binary-copy\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-daemon-config\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290833 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-lib-modules\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52d8bc32-2d42-49fb-9a90-d7403c5e6766-hosts-file\") pod \"node-resolver-r792d\" (UID: \"52d8bc32-2d42-49fb-9a90-d7403c5e6766\") " pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-tuned\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l8m5\" (UniqueName: \"kubernetes.io/projected/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-kube-api-access-7l8m5\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-system-cni-dir\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.291911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/efce9c00-b6c9-46c6-9b78-767fbb88a584-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.290985 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3da00790-e589-4a6c-8e1b-0190c41b51cb-cni-binary-copy\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-sys\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291057 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ghgr\" (UniqueName: \"kubernetes.io/projected/68e22029-463b-4ec1-bd53-3fb5dabcf3bb-kube-api-access-9ghgr\") pod \"iptables-alerter-7h9zw\" (UID: \"68e22029-463b-4ec1-bd53-3fb5dabcf3bb\") " pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-var-lib-cni-bin\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7bd04f2-db63-4ce3-8adb-87a95919989b-agent-certs\") pod \"konnectivity-agent-75cwj\" (UID: \"d7bd04f2-db63-4ce3-8adb-87a95919989b\") " pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-socket-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-conf-dir\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-run-systemd\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291259 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-run-ovn\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291342 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efce9c00-b6c9-46c6-9b78-767fbb88a584-cni-binary-copy\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.292685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291387 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68e22029-463b-4ec1-bd53-3fb5dabcf3bb-iptables-alerter-script\") pod \"iptables-alerter-7h9zw\" (UID: \"68e22029-463b-4ec1-bd53-3fb5dabcf3bb\") " pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291409 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-sys\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291452 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-conf-dir\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291489 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-socket-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291568 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-daemon-config\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.291579 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-tmp\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291608 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/efce9c00-b6c9-46c6-9b78-767fbb88a584-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.291690 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret podName:8a67b74b-29bd-4f2f-9c20-d08eda17ff25 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:19.791646957 +0000 UTC m=+2.107969565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret") pod "global-pull-secret-syncer-22fms" (UID: "8a67b74b-29bd-4f2f-9c20-d08eda17ff25") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-cnibin\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f-serviceca\") pod \"node-ca-b2phd\" (UID: \"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f\") " pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-cni-dir\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291792 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwzp4\" (UniqueName: \"kubernetes.io/projected/52d8bc32-2d42-49fb-9a90-d7403c5e6766-kube-api-access-hwzp4\") pod \"node-resolver-r792d\" (UID: \"52d8bc32-2d42-49fb-9a90-d7403c5e6766\") " pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291838 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3da00790-e589-4a6c-8e1b-0190c41b51cb-cni-binary-copy\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.293501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291688 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-system-cni-dir\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291869 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-cnibin\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291908 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-cni-dir\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291912 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-sysconfig\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.291992 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-var-lib-cni-bin\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.292105 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.292155 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs podName:b559bb74-1c48-40b3-969e-020253e57e45 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:19.79213868 +0000 UTC m=+2.108461281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs") pod "network-metrics-daemon-8nfpr" (UID: "b559bb74-1c48-40b3-969e-020253e57e45") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-slash\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292259 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-sysconfig\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292297 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efce9c00-b6c9-46c6-9b78-767fbb88a584-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.293971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292307 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-log-socket\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l8qg\" (UniqueName: \"kubernetes.io/projected/edd25d58-7057-474b-9f09-290227d90b5b-kube-api-access-6l8qg\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292390 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-kubernetes\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-kubelet-config\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292435 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f-serviceca\") pod \"node-ca-b2phd\" (UID: \"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f\") " pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292479 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-kubernetes\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-host\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292515 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-kubelet-config\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-hostroot\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292637 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-host\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-run-ovn-kubernetes\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292719 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-hostroot\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttssq\" (UniqueName: \"kubernetes.io/projected/6a4e538e-cd87-4383-b937-ad0a9ca86f10-kube-api-access-ttssq\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292804 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-sysctl-d\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292843 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-os-release\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294450 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-socket-dir-parent\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-run-multus-certs\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-os-release\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-host-run-multus-certs\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.292976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-sysctl-conf\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293044 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-sysctl-d\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8stnt\" (UniqueName: \"kubernetes.io/projected/cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f-kube-api-access-8stnt\") pod \"node-ca-b2phd\" (UID: \"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f\") " pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293091 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-etc-selinux\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-cnibin\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f-host\") pod \"node-ca-b2phd\" (UID: \"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f\") " pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293153 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-sysctl-conf\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293160 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-cnibin\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293199 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f-host\") pod \"node-ca-b2phd\" (UID: \"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f\") " pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293204 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3da00790-e589-4a6c-8e1b-0190c41b51cb-multus-socket-dir-parent\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.294945 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293241 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-registration-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-modprobe-d\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk7jg\" (UniqueName: \"kubernetes.io/projected/b559bb74-1c48-40b3-969e-020253e57e45-kube-api-access-zk7jg\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293360 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/edd25d58-7057-474b-9f09-290227d90b5b-registration-dir\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-modprobe-d\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25czq\" (UniqueName: \"kubernetes.io/projected/3da00790-e589-4a6c-8e1b-0190c41b51cb-kube-api-access-25czq\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-run-openvswitch\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293662 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a4e538e-cd87-4383-b937-ad0a9ca86f10-ovnkube-config\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68e22029-463b-4ec1-bd53-3fb5dabcf3bb-host-slash\") pod \"iptables-alerter-7h9zw\" (UID: \"68e22029-463b-4ec1-bd53-3fb5dabcf3bb\") " pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zsjz\" (UniqueName: \"kubernetes.io/projected/efce9c00-b6c9-46c6-9b78-767fbb88a584-kube-api-access-4zsjz\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.295442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.293751 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68e22029-463b-4ec1-bd53-3fb5dabcf3bb-host-slash\") pod \"iptables-alerter-7h9zw\" (UID: \"68e22029-463b-4ec1-bd53-3fb5dabcf3bb\") " pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.295738 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.295474 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-etc-tuned\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.295738 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.295536 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-tmp\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.295802 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.295755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7bd04f2-db63-4ce3-8adb-87a95919989b-agent-certs\") pod \"konnectivity-agent-75cwj\" (UID: \"d7bd04f2-db63-4ce3-8adb-87a95919989b\") " pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:19.299357 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.299336 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:24:19.299357 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.299357 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:24:19.299520 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.299367 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ld68w for pod openshift-network-diagnostics/network-check-target-bfssb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:19.299520 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.299423 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w podName:79aa75d3-03a4-41b7-a421-621edbfd09d8 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:19.79941041 +0000 UTC m=+2.115733010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ld68w" (UniqueName: "kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w") pod "network-check-target-bfssb" (UID: "79aa75d3-03a4-41b7-a421-621edbfd09d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:19.307383 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.307338 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l8m5\" (UniqueName: \"kubernetes.io/projected/467f1ad5-01b9-4bdb-90ec-6c4b480fa941-kube-api-access-7l8m5\") pod \"tuned-kt8f5\" (UID: \"467f1ad5-01b9-4bdb-90ec-6c4b480fa941\") " pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.307784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.307759 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l8qg\" (UniqueName: \"kubernetes.io/projected/edd25d58-7057-474b-9f09-290227d90b5b-kube-api-access-6l8qg\") pod \"aws-ebs-csi-driver-node-vb4rm\" (UID: \"edd25d58-7057-474b-9f09-290227d90b5b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.307894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.307759 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zsjz\" (UniqueName: \"kubernetes.io/projected/efce9c00-b6c9-46c6-9b78-767fbb88a584-kube-api-access-4zsjz\") pod \"multus-additional-cni-plugins-9j54n\" (UID: \"efce9c00-b6c9-46c6-9b78-767fbb88a584\") " pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.309193 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.309148 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8stnt\" (UniqueName: \"kubernetes.io/projected/cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f-kube-api-access-8stnt\") pod \"node-ca-b2phd\" (UID: \"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f\") " pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.309672 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.309651 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25czq\" (UniqueName: \"kubernetes.io/projected/3da00790-e589-4a6c-8e1b-0190c41b51cb-kube-api-access-25czq\") pod \"multus-8pc8f\" (UID: \"3da00790-e589-4a6c-8e1b-0190c41b51cb\") " pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.310919 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.310891 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wzgdm" Jul 06 20:24:19.311251 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.311230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ghgr\" (UniqueName: \"kubernetes.io/projected/68e22029-463b-4ec1-bd53-3fb5dabcf3bb-kube-api-access-9ghgr\") pod \"iptables-alerter-7h9zw\" (UID: \"68e22029-463b-4ec1-bd53-3fb5dabcf3bb\") " pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.311426 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.311409 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk7jg\" (UniqueName: \"kubernetes.io/projected/b559bb74-1c48-40b3-969e-020253e57e45-kube-api-access-zk7jg\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:19.327187 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.327164 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wzgdm" Jul 06 20:24:19.395103 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-run-systemd\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-run-ovn\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395143 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-run-systemd\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395211 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-run-ovn\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwzp4\" (UniqueName: \"kubernetes.io/projected/52d8bc32-2d42-49fb-9a90-d7403c5e6766-kube-api-access-hwzp4\") pod \"node-resolver-r792d\" (UID: \"52d8bc32-2d42-49fb-9a90-d7403c5e6766\") " pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-slash\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-log-socket\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-run-ovn-kubernetes\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttssq\" (UniqueName: \"kubernetes.io/projected/6a4e538e-cd87-4383-b937-ad0a9ca86f10-kube-api-access-ttssq\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395368 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-slash\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-run-openvswitch\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395483 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-run-ovn-kubernetes\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395488 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-log-socket\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a4e538e-cd87-4383-b937-ad0a9ca86f10-ovnkube-config\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395521 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-run-openvswitch\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-node-log\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-cni-netd\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395586 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-node-log\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-systemd-units\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395629 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-systemd-units\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-run-netns\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-cni-netd\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a4e538e-cd87-4383-b937-ad0a9ca86f10-ovn-node-metrics-cert\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.395948 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395767 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-run-netns\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a4e538e-cd87-4383-b937-ad0a9ca86f10-env-overrides\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-etc-openvswitch\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-cni-bin\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395868 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52d8bc32-2d42-49fb-9a90-d7403c5e6766-tmp-dir\") pod \"node-resolver-r792d\" (UID: \"52d8bc32-2d42-49fb-9a90-d7403c5e6766\") " pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-kubelet\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395907 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-etc-openvswitch\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395921 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-cni-bin\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-var-lib-openvswitch\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395958 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-var-lib-openvswitch\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.396005 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a4e538e-cd87-4383-b937-ad0a9ca86f10-host-kubelet\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.395974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a4e538e-cd87-4383-b937-ad0a9ca86f10-ovnkube-script-lib\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.396101 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6a4e538e-cd87-4383-b937-ad0a9ca86f10-ovnkube-config\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.396123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52d8bc32-2d42-49fb-9a90-d7403c5e6766-hosts-file\") pod \"node-resolver-r792d\" (UID: \"52d8bc32-2d42-49fb-9a90-d7403c5e6766\") " pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.396231 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52d8bc32-2d42-49fb-9a90-d7403c5e6766-hosts-file\") pod \"node-resolver-r792d\" (UID: \"52d8bc32-2d42-49fb-9a90-d7403c5e6766\") " pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.396723 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.396294 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6a4e538e-cd87-4383-b937-ad0a9ca86f10-env-overrides\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.397507 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.396300 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52d8bc32-2d42-49fb-9a90-d7403c5e6766-tmp-dir\") pod \"node-resolver-r792d\" (UID: \"52d8bc32-2d42-49fb-9a90-d7403c5e6766\") " pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.397507 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.396487 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6a4e538e-cd87-4383-b937-ad0a9ca86f10-ovnkube-script-lib\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.398509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.398476 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a4e538e-cd87-4383-b937-ad0a9ca86f10-ovn-node-metrics-cert\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.405028 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.405003 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttssq\" (UniqueName: \"kubernetes.io/projected/6a4e538e-cd87-4383-b937-ad0a9ca86f10-kube-api-access-ttssq\") pod \"ovnkube-node-bzmx8\" (UID: \"6a4e538e-cd87-4383-b937-ad0a9ca86f10\") " pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.419340 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.419308 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwzp4\" (UniqueName: \"kubernetes.io/projected/52d8bc32-2d42-49fb-9a90-d7403c5e6766-kube-api-access-hwzp4\") pod \"node-resolver-r792d\" (UID: \"52d8bc32-2d42-49fb-9a90-d7403c5e6766\") " pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.471142 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.471116 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:24:19.493572 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.493543 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9j54n" Jul 06 20:24:19.494042 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.493997 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb9d98d9c0e675fe807d55fcbd0e30a.slice/crio-263f12722b9be8668025efcd52d71c46d3362cb76190df41c8d1d182abbbee8c WatchSource:0}: Error finding container 263f12722b9be8668025efcd52d71c46d3362cb76190df41c8d1d182abbbee8c: Status 404 returned error can't find the container with id 263f12722b9be8668025efcd52d71c46d3362cb76190df41c8d1d182abbbee8c Jul 06 20:24:19.495314 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.495293 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8afef05007b8d8fcc1b2b5da41446350.slice/crio-8293e7c5a9b0a0ffd8fdbf1e38735af6d896a0ec858e120d94d2eb0c62c6a933 WatchSource:0}: Error finding container 8293e7c5a9b0a0ffd8fdbf1e38735af6d896a0ec858e120d94d2eb0c62c6a933: Status 404 returned error can't find the container with id 8293e7c5a9b0a0ffd8fdbf1e38735af6d896a0ec858e120d94d2eb0c62c6a933 Jul 06 20:24:19.500640 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.500623 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:24:19.503032 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.503013 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefce9c00_b6c9_46c6_9b78_767fbb88a584.slice/crio-70d5f1d562555b3c2226d54b96cbb172694ce61a39509bee39f8d00082f2a8f1 WatchSource:0}: Error finding container 70d5f1d562555b3c2226d54b96cbb172694ce61a39509bee39f8d00082f2a8f1: Status 404 returned error can't find the container with id 70d5f1d562555b3c2226d54b96cbb172694ce61a39509bee39f8d00082f2a8f1 Jul 06 20:24:19.533117 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.533022 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7h9zw" Jul 06 20:24:19.541433 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.541409 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e22029_463b_4ec1_bd53_3fb5dabcf3bb.slice/crio-8775e0ddb9fb88e4ad348a72208eec31c9f86d9ea01939747cf60481b618940a WatchSource:0}: Error finding container 8775e0ddb9fb88e4ad348a72208eec31c9f86d9ea01939747cf60481b618940a: Status 404 returned error can't find the container with id 8775e0ddb9fb88e4ad348a72208eec31c9f86d9ea01939747cf60481b618940a Jul 06 20:24:19.548795 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.548770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:19.558693 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.558666 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bd04f2_db63_4ce3_8adb_87a95919989b.slice/crio-71e9fb81df95b50757cb020f280a4374ae4cedc6cccb9eaa633671fbc92887c1 WatchSource:0}: Error finding container 71e9fb81df95b50757cb020f280a4374ae4cedc6cccb9eaa633671fbc92887c1: Status 404 returned error can't find the container with id 71e9fb81df95b50757cb020f280a4374ae4cedc6cccb9eaa633671fbc92887c1 Jul 06 20:24:19.560886 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.560867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" Jul 06 20:24:19.568523 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.568500 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd25d58_7057_474b_9f09_290227d90b5b.slice/crio-990921ece46bbc84e4f207d1124d044d19613e46bb0a3645ba0a5ad9923c4cef WatchSource:0}: Error finding container 990921ece46bbc84e4f207d1124d044d19613e46bb0a3645ba0a5ad9923c4cef: Status 404 returned error can't find the container with id 990921ece46bbc84e4f207d1124d044d19613e46bb0a3645ba0a5ad9923c4cef Jul 06 20:24:19.585419 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.585396 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" Jul 06 20:24:19.590771 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.590747 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b2phd" Jul 06 20:24:19.593114 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.593085 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod467f1ad5_01b9_4bdb_90ec_6c4b480fa941.slice/crio-1f87a6bc88a4add35e7c0608aae09793c342a54e11a3bee84b4bbc8d043e4890 WatchSource:0}: Error finding container 1f87a6bc88a4add35e7c0608aae09793c342a54e11a3bee84b4bbc8d043e4890: Status 404 returned error can't find the container with id 1f87a6bc88a4add35e7c0608aae09793c342a54e11a3bee84b4bbc8d043e4890 Jul 06 20:24:19.598590 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.598563 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf3cb7e8_80bb_4ca7_b3d2_51d220e87f4f.slice/crio-aaf2e22dfeaaf8e092d166042cc95fd78f68b111c5384b87da44beba9f3e2a49 WatchSource:0}: Error finding container aaf2e22dfeaaf8e092d166042cc95fd78f68b111c5384b87da44beba9f3e2a49: Status 404 returned error can't find the container with id aaf2e22dfeaaf8e092d166042cc95fd78f68b111c5384b87da44beba9f3e2a49 Jul 06 20:24:19.605497 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.605477 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8pc8f" Jul 06 20:24:19.613920 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.613894 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da00790_e589_4a6c_8e1b_0190c41b51cb.slice/crio-682e3aa1c5403a62cabc88c1b65d41e5ead59e930b397064ae224a488cea1952 WatchSource:0}: Error finding container 682e3aa1c5403a62cabc88c1b65d41e5ead59e930b397064ae224a488cea1952: Status 404 returned error can't find the container with id 682e3aa1c5403a62cabc88c1b65d41e5ead59e930b397064ae224a488cea1952 Jul 06 20:24:19.633229 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.633189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:19.636978 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.636962 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-r792d" Jul 06 20:24:19.643530 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.643507 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4e538e_cd87_4383_b937_ad0a9ca86f10.slice/crio-2155c06003ea9a6140420742d3d8b25dcfb80a316c706262d8a304f8626f7eac WatchSource:0}: Error finding container 2155c06003ea9a6140420742d3d8b25dcfb80a316c706262d8a304f8626f7eac: Status 404 returned error can't find the container with id 2155c06003ea9a6140420742d3d8b25dcfb80a316c706262d8a304f8626f7eac Jul 06 20:24:19.646831 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:19.646808 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d8bc32_2d42_49fb_9a90_d7403c5e6766.slice/crio-e702c2afe187e731cb37f2bea5d71c746f87ef1dcdc6e26d96e9d90ed4ef8ede WatchSource:0}: Error finding container e702c2afe187e731cb37f2bea5d71c746f87ef1dcdc6e26d96e9d90ed4ef8ede: Status 404 returned error can't find the container with id e702c2afe187e731cb37f2bea5d71c746f87ef1dcdc6e26d96e9d90ed4ef8ede Jul 06 20:24:19.648678 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.648655 2579 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-r792d_openshift-dns(52d8bc32-2d42-49fb-9a90-d7403c5e6766): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 06 20:24:19.648762 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.648690 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-r792d" podUID="52d8bc32-2d42-49fb-9a90-d7403c5e6766" Jul 06 20:24:19.798443 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.798410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:19.798627 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.798448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:19.798627 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.798589 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:19.798753 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.798637 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:19.798753 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.798672 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret podName:8a67b74b-29bd-4f2f-9c20-d08eda17ff25 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:20.798649232 +0000 UTC m=+3.114971850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret") pod "global-pull-secret-syncer-22fms" (UID: "8a67b74b-29bd-4f2f-9c20-d08eda17ff25") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:19.798753 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.798693 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs podName:b559bb74-1c48-40b3-969e-020253e57e45 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:20.798679423 +0000 UTC m=+3.115002022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs") pod "network-metrics-daemon-8nfpr" (UID: "b559bb74-1c48-40b3-969e-020253e57e45") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:19.899409 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:19.899372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:19.899556 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.899542 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:24:19.899616 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.899565 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:24:19.899616 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.899575 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ld68w for pod openshift-network-diagnostics/network-check-target-bfssb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:19.899680 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:19.899630 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w podName:79aa75d3-03a4-41b7-a421-621edbfd09d8 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:20.899616054 +0000 UTC m=+3.215938649 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ld68w" (UniqueName: "kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w") pod "network-check-target-bfssb" (UID: "79aa75d3-03a4-41b7-a421-621edbfd09d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:20.331196 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.331090 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:19:20 +0000 UTC" deadline="2028-02-14 15:17:48.422467031 +0000 UTC" Jul 06 20:24:20.331196 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.331133 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14106h53m28.09133883s" Jul 06 20:24:20.457733 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.457187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:20.457733 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.457319 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:20.482490 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.482420 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" event={"ID":"467f1ad5-01b9-4bdb-90ec-6c4b480fa941","Type":"ContainerStarted","Data":"1f87a6bc88a4add35e7c0608aae09793c342a54e11a3bee84b4bbc8d043e4890"} Jul 06 20:24:20.496759 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.496714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75cwj" event={"ID":"d7bd04f2-db63-4ce3-8adb-87a95919989b","Type":"ContainerStarted","Data":"71e9fb81df95b50757cb020f280a4374ae4cedc6cccb9eaa633671fbc92887c1"} Jul 06 20:24:20.511184 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.510896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9j54n" event={"ID":"efce9c00-b6c9-46c6-9b78-767fbb88a584","Type":"ContainerStarted","Data":"70d5f1d562555b3c2226d54b96cbb172694ce61a39509bee39f8d00082f2a8f1"} Jul 06 20:24:20.528682 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.528638 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" event={"ID":"ffb9d98d9c0e675fe807d55fcbd0e30a","Type":"ContainerStarted","Data":"263f12722b9be8668025efcd52d71c46d3362cb76190df41c8d1d182abbbee8c"} Jul 06 20:24:20.539810 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.539768 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerStarted","Data":"2155c06003ea9a6140420742d3d8b25dcfb80a316c706262d8a304f8626f7eac"} Jul 06 20:24:20.546805 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.546696 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" event={"ID":"edd25d58-7057-474b-9f09-290227d90b5b","Type":"ContainerStarted","Data":"990921ece46bbc84e4f207d1124d044d19613e46bb0a3645ba0a5ad9923c4cef"} Jul 06 20:24:20.558281 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.558244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7h9zw" event={"ID":"68e22029-463b-4ec1-bd53-3fb5dabcf3bb","Type":"ContainerStarted","Data":"8775e0ddb9fb88e4ad348a72208eec31c9f86d9ea01939747cf60481b618940a"} Jul 06 20:24:20.564397 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.564363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" event={"ID":"8afef05007b8d8fcc1b2b5da41446350","Type":"ContainerStarted","Data":"8293e7c5a9b0a0ffd8fdbf1e38735af6d896a0ec858e120d94d2eb0c62c6a933"} Jul 06 20:24:20.572628 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.572586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r792d" event={"ID":"52d8bc32-2d42-49fb-9a90-d7403c5e6766","Type":"ContainerStarted","Data":"e702c2afe187e731cb37f2bea5d71c746f87ef1dcdc6e26d96e9d90ed4ef8ede"} Jul 06 20:24:20.583565 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.583492 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:28389dd118629aa9d7c2525202f3ad6359afb98b6a3bf7672cb1ecfae2418e23\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-r792d" podUID="52d8bc32-2d42-49fb-9a90-d7403c5e6766" Jul 06 20:24:20.588162 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.588132 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8pc8f" event={"ID":"3da00790-e589-4a6c-8e1b-0190c41b51cb","Type":"ContainerStarted","Data":"682e3aa1c5403a62cabc88c1b65d41e5ead59e930b397064ae224a488cea1952"} Jul 06 20:24:20.595996 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.595968 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2phd" event={"ID":"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f","Type":"ContainerStarted","Data":"aaf2e22dfeaaf8e092d166042cc95fd78f68b111c5384b87da44beba9f3e2a49"} Jul 06 20:24:20.656750 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.656715 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:24:20.761025 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.760898 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:24:20.807675 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.807632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:20.807864 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.807691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:20.807864 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.807828 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:20.807864 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.807842 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:20.808031 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.807905 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs podName:b559bb74-1c48-40b3-969e-020253e57e45 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:22.807885853 +0000 UTC m=+5.124208449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs") pod "network-metrics-daemon-8nfpr" (UID: "b559bb74-1c48-40b3-969e-020253e57e45") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:20.808031 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.807926 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret podName:8a67b74b-29bd-4f2f-9c20-d08eda17ff25 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:22.807915539 +0000 UTC m=+5.124238139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret") pod "global-pull-secret-syncer-22fms" (UID: "8a67b74b-29bd-4f2f-9c20-d08eda17ff25") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:20.908212 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:20.908125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:20.908399 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.908285 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:24:20.908399 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.908307 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:24:20.908399 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.908328 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ld68w for pod openshift-network-diagnostics/network-check-target-bfssb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:20.908399 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:20.908389 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w podName:79aa75d3-03a4-41b7-a421-621edbfd09d8 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:22.908370966 +0000 UTC m=+5.224693579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ld68w" (UniqueName: "kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w") pod "network-check-target-bfssb" (UID: "79aa75d3-03a4-41b7-a421-621edbfd09d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:21.332349 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:21.332246 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:19:20 +0000 UTC" deadline="2028-02-21 19:15:42.911905062 +0000 UTC" Jul 06 20:24:21.332349 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:21.332315 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14278h51m21.579594467s" Jul 06 20:24:21.457247 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:21.456392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:21.457247 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:21.456558 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:21.457247 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:21.457076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:21.457247 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:21.457190 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:22.457344 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:22.457309 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:22.457957 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:22.457455 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:22.824661 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:22.824620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:22.824866 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:22.824681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:22.824866 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:22.824819 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:22.824866 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:22.824820 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:22.825132 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:22.824886 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs podName:b559bb74-1c48-40b3-969e-020253e57e45 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:26.824863808 +0000 UTC m=+9.141186426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs") pod "network-metrics-daemon-8nfpr" (UID: "b559bb74-1c48-40b3-969e-020253e57e45") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:22.825132 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:22.824909 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret podName:8a67b74b-29bd-4f2f-9c20-d08eda17ff25 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:26.824896475 +0000 UTC m=+9.141219072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret") pod "global-pull-secret-syncer-22fms" (UID: "8a67b74b-29bd-4f2f-9c20-d08eda17ff25") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:22.925776 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:22.925739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:22.925987 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:22.925964 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:24:22.925987 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:22.925987 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:24:22.926173 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:22.926001 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ld68w for pod openshift-network-diagnostics/network-check-target-bfssb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:22.926173 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:22.926080 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w podName:79aa75d3-03a4-41b7-a421-621edbfd09d8 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:26.926059672 +0000 UTC m=+9.242382284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ld68w" (UniqueName: "kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w") pod "network-check-target-bfssb" (UID: "79aa75d3-03a4-41b7-a421-621edbfd09d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:23.455784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:23.455754 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:23.455979 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:23.455871 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:23.456094 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:23.456076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:23.456205 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:23.456182 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:24.455966 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:24.455930 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:24.456479 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:24.456095 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:25.455737 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:25.455704 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:25.456030 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:25.455848 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:25.456030 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:25.455950 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:25.456557 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:25.456075 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:26.456048 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:26.456009 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:26.456521 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:26.456160 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:26.865226 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:26.865180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:26.865429 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:26.865237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:26.865429 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:26.865351 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:26.865429 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:26.865367 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:26.865429 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:26.865425 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret podName:8a67b74b-29bd-4f2f-9c20-d08eda17ff25 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:34.865404714 +0000 UTC m=+17.181727309 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret") pod "global-pull-secret-syncer-22fms" (UID: "8a67b74b-29bd-4f2f-9c20-d08eda17ff25") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:26.865656 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:26.865449 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs podName:b559bb74-1c48-40b3-969e-020253e57e45 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:34.865437065 +0000 UTC m=+17.181759669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs") pod "network-metrics-daemon-8nfpr" (UID: "b559bb74-1c48-40b3-969e-020253e57e45") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:26.965803 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:26.965765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:26.965989 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:26.965953 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:24:26.965989 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:26.965976 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:24:26.965989 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:26.966003 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ld68w for pod openshift-network-diagnostics/network-check-target-bfssb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:26.966184 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:26.966069 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w podName:79aa75d3-03a4-41b7-a421-621edbfd09d8 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:34.966049286 +0000 UTC m=+17.282371882 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ld68w" (UniqueName: "kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w") pod "network-check-target-bfssb" (UID: "79aa75d3-03a4-41b7-a421-621edbfd09d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:27.455578 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:27.455546 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:27.455578 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:27.455564 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:27.455844 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:27.455720 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:27.455901 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:27.455852 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:28.456789 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:28.456512 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:28.456789 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:28.456634 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:29.455887 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:29.455802 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:29.455887 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:29.455826 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:29.456134 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:29.455932 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:29.456134 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:29.456076 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:30.456116 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:30.456084 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:30.456571 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:30.456211 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:31.456033 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:31.455995 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:31.456205 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:31.456005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:31.456205 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:31.456093 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:31.456205 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:31.456169 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:32.455700 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:32.455654 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:32.455884 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:32.455793 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:33.455543 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:33.455507 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:33.455543 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:33.455542 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:33.456034 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:33.455646 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:33.456034 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:33.455730 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:34.456178 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:34.456131 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:34.456643 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:34.456283 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:34.928122 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:34.928078 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:34.928327 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:34.928131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:34.928327 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:34.928249 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:34.928327 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:34.928254 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:34.928327 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:34.928314 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs podName:b559bb74-1c48-40b3-969e-020253e57e45 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:50.928296407 +0000 UTC m=+33.244619007 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs") pod "network-metrics-daemon-8nfpr" (UID: "b559bb74-1c48-40b3-969e-020253e57e45") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:34.928327 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:34.928332 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret podName:8a67b74b-29bd-4f2f-9c20-d08eda17ff25 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:50.928324115 +0000 UTC m=+33.244646709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret") pod "global-pull-secret-syncer-22fms" (UID: "8a67b74b-29bd-4f2f-9c20-d08eda17ff25") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:35.028969 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:35.028930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:35.029144 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:35.029102 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:24:35.029144 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:35.029129 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:24:35.029144 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:35.029140 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ld68w for pod openshift-network-diagnostics/network-check-target-bfssb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:35.029274 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:35.029192 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w podName:79aa75d3-03a4-41b7-a421-621edbfd09d8 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:51.029178511 +0000 UTC m=+33.345501105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ld68w" (UniqueName: "kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w") pod "network-check-target-bfssb" (UID: "79aa75d3-03a4-41b7-a421-621edbfd09d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:35.456333 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:35.456293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:35.456333 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:35.456333 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:35.456832 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:35.456409 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:35.456832 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:35.456646 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:36.456237 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:36.456005 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:36.456408 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:36.456340 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:37.456522 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:37.456488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:37.456967 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:37.456488 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:37.456967 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:37.456620 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:37.456967 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:37.456703 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:38.457939 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:38.457911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:38.458369 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:38.458034 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:39.455995 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:39.455938 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:39.455995 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:39.455969 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:39.456222 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:39.456070 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:39.456276 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:39.456219 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:40.456152 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.456127 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:40.456547 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:40.456296 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:40.647294 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.647142 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:24:40.647641 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.647618 2579 generic.go:356] "Generic (PLEG): container finished" podID="6a4e538e-cd87-4383-b937-ad0a9ca86f10" containerID="15d27e48d85b827585027686f71d165c2c0217f2ce09ed32217fe2dec16983d0" exitCode=1 Jul 06 20:24:40.647735 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.647688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerStarted","Data":"94e864f50646b883936c6dd0d66843ea5ce2ec9735ec3ca160382bb09a867a31"} Jul 06 20:24:40.647806 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.647793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerStarted","Data":"24555bda83f004461f1e7e5fe377a4351a881e770f9cc79ecf4b689bb557c8ba"} Jul 06 20:24:40.647843 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.647830 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerDied","Data":"15d27e48d85b827585027686f71d165c2c0217f2ce09ed32217fe2dec16983d0"} Jul 06 20:24:40.647876 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.647867 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerStarted","Data":"a46d7bf1122b14bce017386668c27cfe76956abf095c52d0759312263171d294"} Jul 06 20:24:40.649117 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.649090 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" event={"ID":"8afef05007b8d8fcc1b2b5da41446350","Type":"ContainerStarted","Data":"e02c727aba5198745701e3f2f0ba6454392c02decba3ec356a5e58b7d7da46f4"} Jul 06 20:24:40.650828 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.650793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8pc8f" event={"ID":"3da00790-e589-4a6c-8e1b-0190c41b51cb","Type":"ContainerStarted","Data":"da0f4377cf1fabbad7340237f87eb6b9db4623d1ac1fce15dbad9b43458ec45d"} Jul 06 20:24:40.652157 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.652134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" event={"ID":"467f1ad5-01b9-4bdb-90ec-6c4b480fa941","Type":"ContainerStarted","Data":"8406972f36cc2896efb727b2ad38cf7e513bbf99a9e9930b1f0ebf4875ab466d"} Jul 06 20:24:40.663748 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.663709 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-213.ec2.internal" podStartSLOduration=21.663696203 podStartE2EDuration="21.663696203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:40.663196394 +0000 UTC m=+22.979519011" watchObservedRunningTime="2026-07-06 20:24:40.663696203 +0000 UTC m=+22.980018818" Jul 06 20:24:40.682453 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.682394 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kt8f5" podStartSLOduration=1.302324801 podStartE2EDuration="21.682375211s" totalImagesPullingTime="20.38005041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:40.682275264 +0000 UTC m=+22.998597892" watchObservedRunningTime="2026-07-06 20:24:40.682375211 +0000 UTC m=+22.998697830" Jul 06 20:24:40.708019 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:40.707954 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8pc8f" podStartSLOduration=1.334977383 podStartE2EDuration="21.707938602s" totalImagesPullingTime="20.372961219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:40.706208123 +0000 UTC m=+23.022530739" watchObservedRunningTime="2026-07-06 20:24:40.707938602 +0000 UTC m=+23.024261218" Jul 06 20:24:41.455993 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.455902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:41.456165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.455901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:41.456165 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:41.456025 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:41.456165 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:41.456103 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:41.655848 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.655808 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b2phd" event={"ID":"cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f","Type":"ContainerStarted","Data":"edbd5bbff21d021a19bfb6e3a9f3b3615c552e3647f7396e08c90e4a801f1faa"} Jul 06 20:24:41.657151 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.657117 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75cwj" event={"ID":"d7bd04f2-db63-4ce3-8adb-87a95919989b","Type":"ContainerStarted","Data":"93c5dd1bdb96827b1462f2ae843ee199a625c868ff5916b225389ede1db1be00"} Jul 06 20:24:41.658575 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.658552 2579 generic.go:356] "Generic (PLEG): container finished" podID="efce9c00-b6c9-46c6-9b78-767fbb88a584" containerID="4fba5ebac8b05842f2f9c804755cde47bb73feaefdbf9e2d504c1c6e1e0d21e2" exitCode=0 Jul 06 20:24:41.658659 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.658622 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9j54n" event={"ID":"efce9c00-b6c9-46c6-9b78-767fbb88a584","Type":"ContainerDied","Data":"4fba5ebac8b05842f2f9c804755cde47bb73feaefdbf9e2d504c1c6e1e0d21e2"} Jul 06 20:24:41.660234 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.660135 2579 generic.go:356] "Generic (PLEG): container finished" podID="ffb9d98d9c0e675fe807d55fcbd0e30a" containerID="5f88c5ae814975ebc73556d6f7888279e66eacf7a730fc333d02bbf8d6784c3d" exitCode=0 Jul 06 20:24:41.660234 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.660210 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" event={"ID":"ffb9d98d9c0e675fe807d55fcbd0e30a","Type":"ContainerDied","Data":"5f88c5ae814975ebc73556d6f7888279e66eacf7a730fc333d02bbf8d6784c3d"} Jul 06 20:24:41.662990 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.662961 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:24:41.663375 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.663351 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerStarted","Data":"3e69d6c915b34fe155a337f09d577e30aaa43531219707e088ba6acda8f226b5"} Jul 06 20:24:41.663445 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.663412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerStarted","Data":"8b26339c31ca3cc2a1226fad9c06d837578a8a5a8be13b03581fbe0fe38f4515"} Jul 06 20:24:41.664621 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.664603 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" event={"ID":"edd25d58-7057-474b-9f09-290227d90b5b","Type":"ContainerStarted","Data":"4c0a95d4fdedc61eff8123c4aa60035c6e5f3c5c46f168ba2ef80dee227c630e"} Jul 06 20:24:41.666382 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.666363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7h9zw" event={"ID":"68e22029-463b-4ec1-bd53-3fb5dabcf3bb","Type":"ContainerStarted","Data":"cda582d44fd81a118cc92fe09967997a26a5a7ea7a5d6b63f3b5934b8e57a429"} Jul 06 20:24:41.667700 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.667682 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-r792d" event={"ID":"52d8bc32-2d42-49fb-9a90-d7403c5e6766","Type":"ContainerStarted","Data":"071a64f136c0983dfbfa3d9355e0ab2221c5e340c6ac31804b119b654a28918a"} Jul 06 20:24:41.674940 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.674900 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b2phd" podStartSLOduration=2.301367454 podStartE2EDuration="22.674888586s" totalImagesPullingTime="20.373521132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:41.67460963 +0000 UTC m=+23.990932246" watchObservedRunningTime="2026-07-06 20:24:41.674888586 +0000 UTC m=+23.991211202" Jul 06 20:24:41.733106 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.732841 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-r792d" podStartSLOduration=22.732822733 podStartE2EDuration="22.732822733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-06 20:24:41.732636792 +0000 UTC m=+24.048959410" watchObservedRunningTime="2026-07-06 20:24:41.732822733 +0000 UTC m=+24.049145373" Jul 06 20:24:41.733441 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.733409 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7h9zw" podStartSLOduration=2.302694096 podStartE2EDuration="22.733399174s" totalImagesPullingTime="20.430705078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:41.715785058 +0000 UTC m=+24.032107676" watchObservedRunningTime="2026-07-06 20:24:41.733399174 +0000 UTC m=+24.049721790" Jul 06 20:24:41.813789 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.813736 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-75cwj" podStartSLOduration=7.08255121 podStartE2EDuration="22.813716778s" totalImagesPullingTime="15.731165568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:41.812925952 +0000 UTC m=+24.129248568" watchObservedRunningTime="2026-07-06 20:24:41.813716778 +0000 UTC m=+24.130039385" Jul 06 20:24:41.961824 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:41.961769 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:42.030775 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.030698 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:42.288338 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.288257 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:42.388430 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.388397 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:42.456066 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.456046 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:42.456186 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:42.456143 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:42.573150 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.573128 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:24:42.671737 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.671700 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" event={"ID":"ffb9d98d9c0e675fe807d55fcbd0e30a","Type":"ContainerStarted","Data":"a098a5448cc85875aef1adda9e2ba8e008b9a8df1b5fe00a847fceff7db17ac1"} Jul 06 20:24:42.673396 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.673371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" event={"ID":"edd25d58-7057-474b-9f09-290227d90b5b","Type":"ContainerStarted","Data":"fecb7dd3d33bf3ca8f45cdca815fce3dbd2731f9a42357d6b59bf3fcc02d0aba"} Jul 06 20:24:42.690847 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.690803 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-213.ec2.internal" podStartSLOduration=23.69078935 podStartE2EDuration="23.69078935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:42.690523 +0000 UTC m=+25.006845616" watchObservedRunningTime="2026-07-06 20:24:42.69078935 +0000 UTC m=+25.007111965" Jul 06 20:24:42.696005 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.695962 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:42.776582 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:42.776548 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:43.297079 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.296932 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:24:42.5731416Z","UUID":"9151792a-426c-489e-a2af-57af4d16dcde","Handler":null,"Name":"","Endpoint":""} Jul 06 20:24:43.299328 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.299084 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:24:43.299328 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.299125 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:24:43.455818 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.455790 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:43.456000 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:43.455895 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:43.456000 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.455964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:43.456124 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:43.456102 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:43.503319 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.503279 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:43.678116 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.678091 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:24:43.678494 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.678469 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerStarted","Data":"88e198597f8fe29c7e5981dc4205c65bb03996d971fb68af1e9dd5664098f19b"} Jul 06 20:24:43.890188 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.890108 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:43.991671 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:43.991635 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:44.423943 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:44.423911 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:44.456135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:44.456107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:44.456270 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:44.456213 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:44.524432 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:44.524397 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:44.683491 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:44.683412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" event={"ID":"edd25d58-7057-474b-9f09-290227d90b5b","Type":"ContainerStarted","Data":"200cc31802fc0aeabda816e6f75a9f5b0a3968aaa62156dea955ad6cfac899e6"} Jul 06 20:24:44.701199 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:44.701147 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vb4rm" podStartSLOduration=3.030860337 podStartE2EDuration="25.701133483s" totalImagesPullingTime="22.670273146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:44.700992697 +0000 UTC m=+27.017315303" watchObservedRunningTime="2026-07-06 20:24:44.701133483 +0000 UTC m=+27.017456098" Jul 06 20:24:44.885707 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:44.885677 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:45.021358 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.021265 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:45.021891 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.021872 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:45.455878 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.455703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:45.456092 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.455703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:45.456092 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:45.455997 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:45.456092 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:45.456058 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:45.689212 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.689191 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:24:45.689568 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.689548 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerStarted","Data":"d2ed9b2e9cece2365d9fa3c65536e42737857f89df435a380447c6b3d7bec8b6"} Jul 06 20:24:45.689993 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.689954 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:45.690154 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.690136 2579 scope.go:117] "RemoveContainer" containerID="15d27e48d85b827585027686f71d165c2c0217f2ce09ed32217fe2dec16983d0" Jul 06 20:24:45.690229 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.690212 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-75cwj" Jul 06 20:24:45.788203 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:45.788164 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:46.455717 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:46.455686 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:46.455896 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:46.455814 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:46.696340 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:46.696314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:24:46.696895 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:46.696733 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" event={"ID":"6a4e538e-cd87-4383-b937-ad0a9ca86f10","Type":"ContainerStarted","Data":"ec16ede67bb8e12d4f544e932cbb69bd34c649a89853f5198a47f88d37c85418"} Jul 06 20:24:46.697443 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:46.697080 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:46.697443 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:46.697149 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:46.697443 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:46.697193 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:46.714874 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:46.714800 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:46.716212 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:46.716176 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:24:46.727087 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:46.727032 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" podStartSLOduration=7.171115085 podStartE2EDuration="27.727013507s" totalImagesPullingTime="20.555898422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:46.725991493 +0000 UTC m=+29.042314124" watchObservedRunningTime="2026-07-06 20:24:46.727013507 +0000 UTC m=+29.043336121" Jul 06 20:24:47.210972 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:47.210784 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22fms"] Jul 06 20:24:47.211147 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:47.211082 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:47.211221 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:47.211199 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:47.214145 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:47.214121 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8nfpr"] Jul 06 20:24:47.214282 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:47.214235 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:47.214369 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:47.214344 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:47.214802 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:47.214780 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bfssb"] Jul 06 20:24:47.214910 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:47.214865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:47.214961 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:47.214944 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:48.457331 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:48.457222 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:48.457760 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:48.457361 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:48.702926 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:48.702893 2579 generic.go:356] "Generic (PLEG): container finished" podID="efce9c00-b6c9-46c6-9b78-767fbb88a584" containerID="18fb1891d712344ba11ca5dcf43dee3ff03e5fb125eceb5fec69d17ee1209aed" exitCode=0 Jul 06 20:24:48.703108 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:48.702998 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9j54n" event={"ID":"efce9c00-b6c9-46c6-9b78-767fbb88a584","Type":"ContainerDied","Data":"18fb1891d712344ba11ca5dcf43dee3ff03e5fb125eceb5fec69d17ee1209aed"} Jul 06 20:24:49.456265 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:49.456187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:49.456414 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:49.456187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:49.456414 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:49.456302 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:49.456414 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:49.456368 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:49.708256 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:49.708172 2579 generic.go:356] "Generic (PLEG): container finished" podID="efce9c00-b6c9-46c6-9b78-767fbb88a584" containerID="825daa04f3bb3c9141a1f030aaf3474e432da53b6f7c00caf6ef6ba775d2f033" exitCode=0 Jul 06 20:24:49.708256 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:49.708228 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9j54n" event={"ID":"efce9c00-b6c9-46c6-9b78-767fbb88a584","Type":"ContainerDied","Data":"825daa04f3bb3c9141a1f030aaf3474e432da53b6f7c00caf6ef6ba775d2f033"} Jul 06 20:24:50.455917 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:50.455884 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:50.456119 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:50.456010 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:50.713231 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:50.713151 2579 generic.go:356] "Generic (PLEG): container finished" podID="efce9c00-b6c9-46c6-9b78-767fbb88a584" containerID="ee998d9854397eaddc478d7c9ef3cbebd651ac3f500b2ef3638304090cc95d94" exitCode=0 Jul 06 20:24:50.713231 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:50.713209 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9j54n" event={"ID":"efce9c00-b6c9-46c6-9b78-767fbb88a584","Type":"ContainerDied","Data":"ee998d9854397eaddc478d7c9ef3cbebd651ac3f500b2ef3638304090cc95d94"} Jul 06 20:24:50.947709 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:50.947676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:50.947709 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:50.947712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:50.947890 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:50.947837 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:50.947890 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:50.947866 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:50.947970 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:50.947914 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret podName:8a67b74b-29bd-4f2f-9c20-d08eda17ff25 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:22.947893894 +0000 UTC m=+65.264216506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret") pod "global-pull-secret-syncer-22fms" (UID: "8a67b74b-29bd-4f2f-9c20-d08eda17ff25") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:24:50.947970 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:50.947929 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs podName:b559bb74-1c48-40b3-969e-020253e57e45 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:22.947921772 +0000 UTC m=+65.264244366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs") pod "network-metrics-daemon-8nfpr" (UID: "b559bb74-1c48-40b3-969e-020253e57e45") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:24:51.048770 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:51.048738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:51.048914 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:51.048862 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:24:51.048914 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:51.048878 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:24:51.048914 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:51.048887 2579 projected.go:196] Error preparing data for projected volume kube-api-access-ld68w for pod openshift-network-diagnostics/network-check-target-bfssb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:51.049055 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:51.048933 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w podName:79aa75d3-03a4-41b7-a421-621edbfd09d8 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:23.048920811 +0000 UTC m=+65.365243405 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ld68w" (UniqueName: "kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w") pod "network-check-target-bfssb" (UID: "79aa75d3-03a4-41b7-a421-621edbfd09d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:24:51.455842 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:51.455753 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:51.455842 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:51.455777 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:51.456066 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:51.455876 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:51.456066 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:51.455998 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:52.455942 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:52.455894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:52.456404 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:52.456064 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8nfpr" podUID="b559bb74-1c48-40b3-969e-020253e57e45" Jul 06 20:24:53.456080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.456041 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:53.456561 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.456042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:53.456561 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:53.456148 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bfssb" podUID="79aa75d3-03a4-41b7-a421-621edbfd09d8" Jul 06 20:24:53.456561 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:53.456261 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22fms" podUID="8a67b74b-29bd-4f2f-9c20-d08eda17ff25" Jul 06 20:24:53.923020 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.922971 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-213.ec2.internal" event="NodeReady" Jul 06 20:24:53.923348 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.923173 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:24:53.981625 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.981582 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c7sfk"] Jul 06 20:24:53.983910 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.983890 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:53.986549 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.986525 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:24:53.987195 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.987176 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qvcv5\"" Jul 06 20:24:53.989577 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.989556 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:24:53.991767 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.991745 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vsj4b"] Jul 06 20:24:53.993733 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.993714 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vsj4b" Jul 06 20:24:53.996570 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.996478 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:24:53.996570 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.996556 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:24:53.996726 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.996667 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:24:53.997777 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:53.997763 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l5krs\"" Jul 06 20:24:54.006378 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.006354 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c7sfk"] Jul 06 20:24:54.023145 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.023116 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vsj4b"] Jul 06 20:24:54.069740 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.069705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6c8eeb7-12f5-4594-b3ac-1c636928e609-tmp-dir\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.069930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.069780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c8eeb7-12f5-4594-b3ac-1c636928e609-config-volume\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.069930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.069869 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwgn2\" (UniqueName: \"kubernetes.io/projected/f6c8eeb7-12f5-4594-b3ac-1c636928e609-kube-api-access-xwgn2\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.069930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.069918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52e3233d-4675-4171-b69d-aabc47fb581c-cert\") pod \"ingress-canary-vsj4b\" (UID: \"52e3233d-4675-4171-b69d-aabc47fb581c\") " pod="openshift-ingress-canary/ingress-canary-vsj4b" Jul 06 20:24:54.070099 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.069945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.070099 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.069996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlr4z\" (UniqueName: \"kubernetes.io/projected/52e3233d-4675-4171-b69d-aabc47fb581c-kube-api-access-mlr4z\") pod \"ingress-canary-vsj4b\" (UID: \"52e3233d-4675-4171-b69d-aabc47fb581c\") " pod="openshift-ingress-canary/ingress-canary-vsj4b" Jul 06 20:24:54.171190 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.171150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlr4z\" (UniqueName: \"kubernetes.io/projected/52e3233d-4675-4171-b69d-aabc47fb581c-kube-api-access-mlr4z\") pod \"ingress-canary-vsj4b\" (UID: \"52e3233d-4675-4171-b69d-aabc47fb581c\") " pod="openshift-ingress-canary/ingress-canary-vsj4b" Jul 06 20:24:54.171378 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.171204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6c8eeb7-12f5-4594-b3ac-1c636928e609-tmp-dir\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.171378 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.171267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c8eeb7-12f5-4594-b3ac-1c636928e609-config-volume\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.171378 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.171314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwgn2\" (UniqueName: \"kubernetes.io/projected/f6c8eeb7-12f5-4594-b3ac-1c636928e609-kube-api-access-xwgn2\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.171378 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.171349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52e3233d-4675-4171-b69d-aabc47fb581c-cert\") pod \"ingress-canary-vsj4b\" (UID: \"52e3233d-4675-4171-b69d-aabc47fb581c\") " pod="openshift-ingress-canary/ingress-canary-vsj4b" Jul 06 20:24:54.171378 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.171375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.171643 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:54.171494 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:24:54.171643 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:54.171563 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls podName:f6c8eeb7-12f5-4594-b3ac-1c636928e609 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:54.671542284 +0000 UTC m=+36.987864897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls") pod "dns-default-c7sfk" (UID: "f6c8eeb7-12f5-4594-b3ac-1c636928e609") : secret "dns-default-metrics-tls" not found Jul 06 20:24:54.171911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.171880 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6c8eeb7-12f5-4594-b3ac-1c636928e609-tmp-dir\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.172321 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.172302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f6c8eeb7-12f5-4594-b3ac-1c636928e609-config-volume\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.173196 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.173108 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:54.176577 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.176456 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52e3233d-4675-4171-b69d-aabc47fb581c-cert\") pod \"ingress-canary-vsj4b\" (UID: \"52e3233d-4675-4171-b69d-aabc47fb581c\") " pod="openshift-ingress-canary/ingress-canary-vsj4b" Jul 06 20:24:54.179900 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.179877 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwgn2\" (UniqueName: \"kubernetes.io/projected/f6c8eeb7-12f5-4594-b3ac-1c636928e609-kube-api-access-xwgn2\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.180031 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.180010 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlr4z\" (UniqueName: \"kubernetes.io/projected/52e3233d-4675-4171-b69d-aabc47fb581c-kube-api-access-mlr4z\") pod \"ingress-canary-vsj4b\" (UID: \"52e3233d-4675-4171-b69d-aabc47fb581c\") " pod="openshift-ingress-canary/ingress-canary-vsj4b" Jul 06 20:24:54.260178 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.260143 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:54.302340 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.302302 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vsj4b" Jul 06 20:24:54.408067 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.408014 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:54.456262 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.456182 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:24:54.458533 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.458508 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:24:54.458669 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.458582 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qsjzg\"" Jul 06 20:24:54.509549 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.509514 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:54.675759 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:54.675725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:54.675923 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:54.675877 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:24:54.676009 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:54.675944 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls podName:f6c8eeb7-12f5-4594-b3ac-1c636928e609 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:55.675922505 +0000 UTC m=+37.992245107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls") pod "dns-default-c7sfk" (UID: "f6c8eeb7-12f5-4594-b3ac-1c636928e609") : secret "dns-default-metrics-tls" not found Jul 06 20:24:55.456422 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:55.456390 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:24:55.456893 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:55.456586 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:24:55.459220 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:55.459124 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:24:55.459802 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:55.459775 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:24:55.459920 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:55.459775 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:24:55.459920 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:55.459861 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrkdh\"" Jul 06 20:24:55.683490 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:55.683460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:55.683623 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:55.683608 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:24:55.683680 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:55.683670 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls podName:f6c8eeb7-12f5-4594-b3ac-1c636928e609 nodeName:}" failed. No retries permitted until 2026-07-06 20:24:57.683654513 +0000 UTC m=+39.999977117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls") pod "dns-default-c7sfk" (UID: "f6c8eeb7-12f5-4594-b3ac-1c636928e609") : secret "dns-default-metrics-tls" not found Jul 06 20:24:55.721800 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:55.721723 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vsj4b"] Jul 06 20:24:55.797266 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:24:55.797231 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e3233d_4675_4171_b69d_aabc47fb581c.slice/crio-a6d2d30434773ae15123ee76a7ea58a3205735feea89bf99d101698d7024ab93 WatchSource:0}: Error finding container a6d2d30434773ae15123ee76a7ea58a3205735feea89bf99d101698d7024ab93: Status 404 returned error can't find the container with id a6d2d30434773ae15123ee76a7ea58a3205735feea89bf99d101698d7024ab93 Jul 06 20:24:56.100510 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:56.100475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:56.195822 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:56.195790 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:56.730677 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:56.730456 2579 generic.go:356] "Generic (PLEG): container finished" podID="efce9c00-b6c9-46c6-9b78-767fbb88a584" containerID="41420e92fb53bb9bbbe4622e136aba8fb4ccb930b68d11e79c25b29711bce960" exitCode=0 Jul 06 20:24:56.731518 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:56.730547 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9j54n" event={"ID":"efce9c00-b6c9-46c6-9b78-767fbb88a584","Type":"ContainerDied","Data":"41420e92fb53bb9bbbe4622e136aba8fb4ccb930b68d11e79c25b29711bce960"} Jul 06 20:24:56.732057 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:56.732031 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vsj4b" event={"ID":"52e3233d-4675-4171-b69d-aabc47fb581c","Type":"ContainerStarted","Data":"a6d2d30434773ae15123ee76a7ea58a3205735feea89bf99d101698d7024ab93"} Jul 06 20:24:57.701385 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:57.701344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:24:57.701569 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:57.701497 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:24:57.701569 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:24:57.701563 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls podName:f6c8eeb7-12f5-4594-b3ac-1c636928e609 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:01.701546484 +0000 UTC m=+44.017869077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls") pod "dns-default-c7sfk" (UID: "f6c8eeb7-12f5-4594-b3ac-1c636928e609") : secret "dns-default-metrics-tls" not found Jul 06 20:24:57.738024 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:57.737969 2579 generic.go:356] "Generic (PLEG): container finished" podID="efce9c00-b6c9-46c6-9b78-767fbb88a584" containerID="9d64c0500b456f002dd5766b3da7631a79c9a27ff1adac4c351498004b0930ff" exitCode=0 Jul 06 20:24:57.738482 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:57.738046 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9j54n" event={"ID":"efce9c00-b6c9-46c6-9b78-767fbb88a584","Type":"ContainerDied","Data":"9d64c0500b456f002dd5766b3da7631a79c9a27ff1adac4c351498004b0930ff"} Jul 06 20:24:58.400838 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:58.400802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:58.468181 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:58.468142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:58.743937 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:58.743869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9j54n" event={"ID":"efce9c00-b6c9-46c6-9b78-767fbb88a584","Type":"ContainerStarted","Data":"aa88ef4895fa2c9794a210bf019977bfb721e3a0b727f09933b7a9076e1c9c69"} Jul 06 20:24:58.768663 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:58.768574 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9j54n" podStartSLOduration=6.052930176 podStartE2EDuration="39.768554808s" totalImagesPullingTime="33.715624632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:58.767514591 +0000 UTC m=+41.083837207" watchObservedRunningTime="2026-07-06 20:24:58.768554808 +0000 UTC m=+41.084877424" Jul 06 20:24:58.821810 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:58.821778 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:58.913038 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:58.912999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:59.014747 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:59.014652 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:59.112334 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:59.112297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:59.213834 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:59.213793 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:24:59.747931 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:59.747896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vsj4b" event={"ID":"52e3233d-4675-4171-b69d-aabc47fb581c","Type":"ContainerStarted","Data":"375c3b122dfb53faeeb44cb0c25a830dd44def7a12240ff3dabb4f7e15536740"} Jul 06 20:24:59.767082 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:24:59.767033 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vsj4b" podStartSLOduration=3.76512316 podStartE2EDuration="6.767016988s" totalImagesPullingTime="3.001893828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:24:59.766294149 +0000 UTC m=+42.082616766" watchObservedRunningTime="2026-07-06 20:24:59.767016988 +0000 UTC m=+42.083339604" Jul 06 20:25:01.729256 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:01.729215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:25:01.729655 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:01.729343 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:25:01.729655 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:01.729399 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls podName:f6c8eeb7-12f5-4594-b3ac-1c636928e609 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:09.729381768 +0000 UTC m=+52.045704381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls") pod "dns-default-c7sfk" (UID: "f6c8eeb7-12f5-4594-b3ac-1c636928e609") : secret "dns-default-metrics-tls" not found Jul 06 20:25:09.787773 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:09.787737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:25:09.788262 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:09.787844 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:25:09.788262 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:09.787902 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls podName:f6c8eeb7-12f5-4594-b3ac-1c636928e609 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:25.787887741 +0000 UTC m=+68.104210335 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls") pod "dns-default-c7sfk" (UID: "f6c8eeb7-12f5-4594-b3ac-1c636928e609") : secret "dns-default-metrics-tls" not found Jul 06 20:25:18.713248 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:18.713220 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bzmx8" Jul 06 20:25:18.877114 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:18.877074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:20.161551 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:20.161484 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:22.982525 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:22.982472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:25:22.982525 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:22.982527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:25:22.985116 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:22.985096 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:25:22.985229 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:22.985213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:25:22.993111 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:22.993089 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 20:25:22.993202 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:22.993169 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs podName:b559bb74-1c48-40b3-969e-020253e57e45 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:26.993145053 +0000 UTC m=+129.309467666 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs") pod "network-metrics-daemon-8nfpr" (UID: "b559bb74-1c48-40b3-969e-020253e57e45") : secret "metrics-daemon-secret" not found Jul 06 20:25:22.996116 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:22.996093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8a67b74b-29bd-4f2f-9c20-d08eda17ff25-original-pull-secret\") pod \"global-pull-secret-syncer-22fms\" (UID: \"8a67b74b-29bd-4f2f-9c20-d08eda17ff25\") " pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:25:23.074632 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.074565 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22fms" Jul 06 20:25:23.083768 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.083741 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:25:23.086686 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.086663 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:25:23.097326 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.097300 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:25:23.108040 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.108013 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld68w\" (UniqueName: \"kubernetes.io/projected/79aa75d3-03a4-41b7-a421-621edbfd09d8-kube-api-access-ld68w\") pod \"network-check-target-bfssb\" (UID: \"79aa75d3-03a4-41b7-a421-621edbfd09d8\") " pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:25:23.199997 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.199952 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22fms"] Jul 06 20:25:23.203439 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:25:23.203401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a67b74b_29bd_4f2f_9c20_d08eda17ff25.slice/crio-d8438b6f01b16a5e96beb73f1d5b894f827d6b00072affd84857c823ec19b79b WatchSource:0}: Error finding container d8438b6f01b16a5e96beb73f1d5b894f827d6b00072affd84857c823ec19b79b: Status 404 returned error can't find the container with id d8438b6f01b16a5e96beb73f1d5b894f827d6b00072affd84857c823ec19b79b Jul 06 20:25:23.370346 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.370318 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrkdh\"" Jul 06 20:25:23.378318 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.378293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:25:23.507715 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.507676 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bfssb"] Jul 06 20:25:23.512505 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:25:23.512481 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79aa75d3_03a4_41b7_a421_621edbfd09d8.slice/crio-ef56be29e14d2404a6bed4ee6843b3ee1560b64c8345b0d1df77b1c15529469c WatchSource:0}: Error finding container ef56be29e14d2404a6bed4ee6843b3ee1560b64c8345b0d1df77b1c15529469c: Status 404 returned error can't find the container with id ef56be29e14d2404a6bed4ee6843b3ee1560b64c8345b0d1df77b1c15529469c Jul 06 20:25:23.805309 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.805270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22fms" event={"ID":"8a67b74b-29bd-4f2f-9c20-d08eda17ff25","Type":"ContainerStarted","Data":"d8438b6f01b16a5e96beb73f1d5b894f827d6b00072affd84857c823ec19b79b"} Jul 06 20:25:23.806476 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:23.806447 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bfssb" event={"ID":"79aa75d3-03a4-41b7-a421-621edbfd09d8","Type":"ContainerStarted","Data":"ef56be29e14d2404a6bed4ee6843b3ee1560b64c8345b0d1df77b1c15529469c"} Jul 06 20:25:25.804893 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:25.804851 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:25:25.805375 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:25.805038 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:25:25.805375 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:25.805098 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls podName:f6c8eeb7-12f5-4594-b3ac-1c636928e609 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:57.805083731 +0000 UTC m=+100.121406324 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls") pod "dns-default-c7sfk" (UID: "f6c8eeb7-12f5-4594-b3ac-1c636928e609") : secret "dns-default-metrics-tls" not found Jul 06 20:25:28.820611 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:28.820573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bfssb" event={"ID":"79aa75d3-03a4-41b7-a421-621edbfd09d8","Type":"ContainerStarted","Data":"571f0d90da82e103778b953842f4e727cc20422093c6a109aa77e58b0ad9ff4e"} Jul 06 20:25:28.821082 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:28.820653 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:25:28.821951 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:28.821926 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22fms" event={"ID":"8a67b74b-29bd-4f2f-9c20-d08eda17ff25","Type":"ContainerStarted","Data":"9e06d32ab1e4d8da1d5faa8283d8fe317e7d1150b1fb8764c0c1774657f293d2"} Jul 06 20:25:28.837798 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:28.837751 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bfssb" podStartSLOduration=65.170817675 podStartE2EDuration="1m9.837736922s" totalImagesPullingTime="4.666919247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:28.837486532 +0000 UTC m=+71.153809149" watchObservedRunningTime="2026-07-06 20:25:28.837736922 +0000 UTC m=+71.154059516" Jul 06 20:25:28.853781 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:28.853728 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-22fms" podStartSLOduration=64.877684252 podStartE2EDuration="1m9.85371113s" totalImagesPullingTime="4.976026878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:28.853539482 +0000 UTC m=+71.169862101" watchObservedRunningTime="2026-07-06 20:25:28.85371113 +0000 UTC m=+71.170033743" Jul 06 20:25:40.829252 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:40.829130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:40.907113 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:40.907076 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:48.279944 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.279915 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c5764d8c-vljch"] Jul 06 20:25:48.284094 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.284071 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.288767 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.288742 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 20:25:48.288767 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.288761 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 20:25:48.289027 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.288748 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 20:25:48.289027 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.288898 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 20:25:48.289141 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.289077 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 20:25:48.294860 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.294838 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 20:25:48.295022 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.295007 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nzjrw\"" Jul 06 20:25:48.302455 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.302434 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c5764d8c-vljch"] Jul 06 20:25:48.364304 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.364268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-stats-auth\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.364304 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.364310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.364509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.364391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.364509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.364420 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfzlc\" (UniqueName: \"kubernetes.io/projected/c342d055-b73d-4b1a-8b64-165bd700bd79-kube-api-access-zfzlc\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.364509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.364454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-default-certificate\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.375188 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.375156 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-pddnm"] Jul 06 20:25:48.377917 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.377901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.381501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.381472 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 20:25:48.381647 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.381590 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 20:25:48.381647 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.381617 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:25:48.381749 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.381659 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jmt68\"" Jul 06 20:25:48.381850 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.381831 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:25:48.386438 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.386417 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 20:25:48.389505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.389485 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-pddnm"] Jul 06 20:25:48.463899 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.463866 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:48.464756 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.464736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2def55ac-aa00-467f-ac1f-2724be0c6f19-tmp\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.464864 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.464784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-stats-auth\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.464864 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.464814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def55ac-aa00-467f-ac1f-2724be0c6f19-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.464864 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.464848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sldh\" (UniqueName: \"kubernetes.io/projected/2def55ac-aa00-467f-ac1f-2724be0c6f19-kube-api-access-9sldh\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.465085 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.464879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.465085 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.464903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def55ac-aa00-467f-ac1f-2724be0c6f19-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.465085 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.464971 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.465085 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.465013 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfzlc\" (UniqueName: \"kubernetes.io/projected/c342d055-b73d-4b1a-8b64-165bd700bd79-kube-api-access-zfzlc\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.465085 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:48.465056 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:48.965032296 +0000 UTC m=+91.281354907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : configmap references non-existent config key: service-ca.crt Jul 06 20:25:48.465085 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:48.465072 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:25:48.465317 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.465106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-default-certificate\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.465317 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:48.465123 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:48.965111463 +0000 UTC m=+91.281434057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : secret "router-metrics-certs-default" not found Jul 06 20:25:48.465317 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.465153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2def55ac-aa00-467f-ac1f-2724be0c6f19-snapshots\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.465317 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.465178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2def55ac-aa00-467f-ac1f-2724be0c6f19-serving-cert\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.467243 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.467215 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-stats-auth\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.467340 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.467247 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-default-certificate\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.476767 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.476740 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfzlc\" (UniqueName: \"kubernetes.io/projected/c342d055-b73d-4b1a-8b64-165bd700bd79-kube-api-access-zfzlc\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.564548 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.564494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:48.565481 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.565461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2def55ac-aa00-467f-ac1f-2724be0c6f19-snapshots\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.565550 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.565488 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2def55ac-aa00-467f-ac1f-2724be0c6f19-serving-cert\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.565550 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.565507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2def55ac-aa00-467f-ac1f-2724be0c6f19-tmp\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.565550 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.565528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def55ac-aa00-467f-ac1f-2724be0c6f19-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.565676 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.565651 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sldh\" (UniqueName: \"kubernetes.io/projected/2def55ac-aa00-467f-ac1f-2724be0c6f19-kube-api-access-9sldh\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.565725 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.565707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def55ac-aa00-467f-ac1f-2724be0c6f19-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.566082 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.566061 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2def55ac-aa00-467f-ac1f-2724be0c6f19-tmp\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.566194 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.566128 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2def55ac-aa00-467f-ac1f-2724be0c6f19-snapshots\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.566194 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.566155 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def55ac-aa00-467f-ac1f-2724be0c6f19-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.566461 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.566441 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2def55ac-aa00-467f-ac1f-2724be0c6f19-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.567898 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.567881 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2def55ac-aa00-467f-ac1f-2724be0c6f19-serving-cert\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.573938 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.573914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sldh\" (UniqueName: \"kubernetes.io/projected/2def55ac-aa00-467f-ac1f-2724be0c6f19-kube-api-access-9sldh\") pod \"insights-operator-5c847dcfc4-pddnm\" (UID: \"2def55ac-aa00-467f-ac1f-2724be0c6f19\") " pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.687791 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.687742 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" Jul 06 20:25:48.812131 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.812102 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-pddnm"] Jul 06 20:25:48.815761 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:25:48.815705 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2def55ac_aa00_467f_ac1f_2724be0c6f19.slice/crio-16ba8407116e7d36be3510002b63c2ec11ee330a02a1998dce65f949070e39a4 WatchSource:0}: Error finding container 16ba8407116e7d36be3510002b63c2ec11ee330a02a1998dce65f949070e39a4: Status 404 returned error can't find the container with id 16ba8407116e7d36be3510002b63c2ec11ee330a02a1998dce65f949070e39a4 Jul 06 20:25:48.871511 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.871473 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" event={"ID":"2def55ac-aa00-467f-ac1f-2724be0c6f19","Type":"ContainerStarted","Data":"16ba8407116e7d36be3510002b63c2ec11ee330a02a1998dce65f949070e39a4"} Jul 06 20:25:48.969925 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.969889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.970072 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:48.969954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:48.970119 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:48.970065 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:25:48.970161 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:48.970118 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:49.970103373 +0000 UTC m=+92.286425967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : configmap references non-existent config key: service-ca.crt Jul 06 20:25:48.970161 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:48.970136 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:49.970129478 +0000 UTC m=+92.286452072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : secret "router-metrics-certs-default" not found Jul 06 20:25:49.978951 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:49.978908 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:49.979408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:49.979010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:49.979408 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:49.979096 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:51.979069925 +0000 UTC m=+94.295392522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : configmap references non-existent config key: service-ca.crt Jul 06 20:25:49.979408 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:49.979143 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:25:49.979408 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:49.979195 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:51.979178953 +0000 UTC m=+94.295501547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : secret "router-metrics-certs-default" not found Jul 06 20:25:51.880170 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:51.880138 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" event={"ID":"2def55ac-aa00-467f-ac1f-2724be0c6f19","Type":"ContainerStarted","Data":"5f5da5fb178a72bc2b7e1e7fa9ffeefd4fb22af87ce896cd158c4359411f065a"} Jul 06 20:25:51.899433 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:51.899384 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" podStartSLOduration=1.811232075 podStartE2EDuration="3.899365568s" totalImagesPullingTime="2.088133493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:25:51.898317277 +0000 UTC m=+94.214639890" watchObservedRunningTime="2026-07-06 20:25:51.899365568 +0000 UTC m=+94.215688227" Jul 06 20:25:51.993439 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:51.993399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:51.993647 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:51.993481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:51.993647 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:51.993585 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:55.993561641 +0000 UTC m=+98.309884248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : configmap references non-existent config key: service-ca.crt Jul 06 20:25:51.993775 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:51.993663 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:25:51.993775 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:51.993729 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:55.993711007 +0000 UTC m=+98.310033615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : secret "router-metrics-certs-default" not found Jul 06 20:25:52.511597 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.511558 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jhtpl"] Jul 06 20:25:52.515185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.515156 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.519988 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.519957 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:25:52.520354 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.520331 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:25:52.520461 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.520429 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lmvxt\"" Jul 06 20:25:52.530820 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.530784 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhtpl"] Jul 06 20:25:52.598596 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.598562 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:52.598919 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.598895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f65429d-ab7a-4fef-8295-225348965095-data-volume\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.599072 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.598963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jw9n\" (UniqueName: \"kubernetes.io/projected/7f65429d-ab7a-4fef-8295-225348965095-kube-api-access-9jw9n\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.599158 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.599096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f65429d-ab7a-4fef-8295-225348965095-crio-socket\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.599158 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.599123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.599257 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.599153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.667126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.667091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:52.700092 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.700061 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f65429d-ab7a-4fef-8295-225348965095-data-volume\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.700219 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.700096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jw9n\" (UniqueName: \"kubernetes.io/projected/7f65429d-ab7a-4fef-8295-225348965095-kube-api-access-9jw9n\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.700287 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.700268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f65429d-ab7a-4fef-8295-225348965095-crio-socket\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.700327 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.700297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.700380 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.700321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.700426 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.700393 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f65429d-ab7a-4fef-8295-225348965095-crio-socket\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.700464 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:52.700436 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:25:52.700464 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:52.700449 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:25:52.700540 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:52.700491 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:53.200475881 +0000 UTC m=+95.516798474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : configmap "kube-rbac-proxy" not found Jul 06 20:25:52.700540 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:52.700519 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:53.200501431 +0000 UTC m=+95.516824026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : secret "insights-runtime-extractor-tls" not found Jul 06 20:25:52.700540 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.700448 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f65429d-ab7a-4fef-8295-225348965095-data-volume\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:52.712251 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:52.712215 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jw9n\" (UniqueName: \"kubernetes.io/projected/7f65429d-ab7a-4fef-8295-225348965095-kube-api-access-9jw9n\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:53.204713 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:53.204671 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:53.204713 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:53.204711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:53.205241 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:53.204804 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:25:53.205241 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:53.204819 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:25:53.205241 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:53.204869 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:54.204851798 +0000 UTC m=+96.521174409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : configmap "kube-rbac-proxy" not found Jul 06 20:25:53.205241 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:53.204883 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:54.204877349 +0000 UTC m=+96.521199943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : secret "insights-runtime-extractor-tls" not found Jul 06 20:25:54.212991 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:54.212954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:54.213386 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:54.213007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:54.213386 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:54.213089 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:25:54.213386 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:54.213131 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:25:54.213386 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:54.213201 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:56.213129416 +0000 UTC m=+98.529452013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : configmap "kube-rbac-proxy" not found Jul 06 20:25:54.213386 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:54.213217 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:25:56.213208484 +0000 UTC m=+98.529531078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : secret "insights-runtime-extractor-tls" not found Jul 06 20:25:54.719888 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:54.719861 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r792d_52d8bc32-2d42-49fb-9a90-d7403c5e6766/dns-node-resolver/0.log" Jul 06 20:25:55.114583 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:55.114556 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2phd_cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f/node-ca/0.log" Jul 06 20:25:56.027845 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:56.027814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:56.028286 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:56.027887 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:25:56.028286 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:56.028007 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:25:56.028286 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:56.028024 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:04.028009051 +0000 UTC m=+106.344331645 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : configmap references non-existent config key: service-ca.crt Jul 06 20:25:56.028286 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:56.028059 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:04.028045649 +0000 UTC m=+106.344368244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : secret "router-metrics-certs-default" not found Jul 06 20:25:56.127243 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:56.127208 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:56.193594 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:56.193554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:25:56.230060 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:56.230030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:56.230156 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:56.230067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:25:56.230204 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:56.230160 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:25:56.230204 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:56.230171 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:25:56.230272 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:56.230210 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:00.230196114 +0000 UTC m=+102.546518708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : configmap "kube-rbac-proxy" not found Jul 06 20:25:56.230272 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:56.230222 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:00.230216623 +0000 UTC m=+102.546539217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : secret "insights-runtime-extractor-tls" not found Jul 06 20:25:56.312800 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:56.312767 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vsj4b_52e3233d-4675-4171-b69d-aabc47fb581c/serve-healthcheck-canary/0.log" Jul 06 20:25:57.841994 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:57.841940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:25:57.842718 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:57.842690 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:25:57.842919 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:25:57.842907 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls podName:f6c8eeb7-12f5-4594-b3ac-1c636928e609 nodeName:}" failed. No retries permitted until 2026-07-06 20:27:01.842885115 +0000 UTC m=+164.159207729 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls") pod "dns-default-c7sfk" (UID: "f6c8eeb7-12f5-4594-b3ac-1c636928e609") : secret "dns-default-metrics-tls" not found Jul 06 20:25:59.828009 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:25:59.827963 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bfssb" Jul 06 20:26:00.260806 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:00.260711 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:26:00.260806 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:00.260759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:26:00.261019 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:00.260877 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:26:00.261019 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:00.260906 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:26:00.261019 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:00.260943 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:08.260926516 +0000 UTC m=+110.577249133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : secret "insights-runtime-extractor-tls" not found Jul 06 20:26:00.261019 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:00.260959 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:08.260952552 +0000 UTC m=+110.577275146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : configmap "kube-rbac-proxy" not found Jul 06 20:26:01.907821 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:01.907788 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54dc6cd647-p5pf2"] Jul 06 20:26:01.929194 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:01.929167 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54dc6cd647-p5pf2"] Jul 06 20:26:01.929336 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:01.929259 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:01.931908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:01.931872 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 20:26:01.931908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:01.931891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 20:26:01.932132 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:01.931882 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 20:26:01.932132 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:01.931955 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mdtgg\"" Jul 06 20:26:01.941686 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:01.941663 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 20:26:02.074743 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.074710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.074912 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.074765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-certificates\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.074912 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.074793 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-installation-pull-secrets\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.074912 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.074830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnlrg\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-kube-api-access-pnlrg\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.074912 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.074855 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-image-registry-private-configuration\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.075088 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.074992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-ca-trust-extracted\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.075088 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.075031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-bound-sa-token\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.075088 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.075065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-trusted-ca\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.175798 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.175707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-certificates\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.175798 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.175746 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-installation-pull-secrets\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.175798 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.175783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnlrg\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-kube-api-access-pnlrg\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.176118 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.175811 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-image-registry-private-configuration\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.176118 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.175869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-ca-trust-extracted\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.176118 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.175898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-bound-sa-token\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.176118 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.176067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-trusted-ca\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.176348 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.176130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.176348 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:02.176251 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:26:02.176348 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:02.176266 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6cd647-p5pf2: secret "image-registry-tls" not found Jul 06 20:26:02.176348 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.176328 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-ca-trust-extracted\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.176348 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:02.176345 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls podName:deb3fdb5-3b14-4d63-a75f-fbb78929cf87 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:02.676321004 +0000 UTC m=+104.992643612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls") pod "image-registry-54dc6cd647-p5pf2" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87") : secret "image-registry-tls" not found Jul 06 20:26:02.176577 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.176444 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-certificates\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.177036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.177019 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-trusted-ca\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.178307 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.178277 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-image-registry-private-configuration\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.178307 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.178299 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-installation-pull-secrets\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.185218 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.185198 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-bound-sa-token\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.185409 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.185386 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnlrg\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-kube-api-access-pnlrg\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.680035 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:02.680001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:02.680205 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:02.680165 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:26:02.680205 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:02.680187 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6cd647-p5pf2: secret "image-registry-tls" not found Jul 06 20:26:02.680283 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:02.680258 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls podName:deb3fdb5-3b14-4d63-a75f-fbb78929cf87 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:03.680242611 +0000 UTC m=+105.996565210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls") pod "image-registry-54dc6cd647-p5pf2" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87") : secret "image-registry-tls" not found Jul 06 20:26:03.044664 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.044633 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:03.144660 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.144628 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:03.476769 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.476678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:03.499382 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.499348 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j"] Jul 06 20:26:03.501907 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.501887 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j" Jul 06 20:26:03.504479 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.504460 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 20:26:03.504587 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.504523 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 20:26:03.504587 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.504578 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5kzl7\"" Jul 06 20:26:03.521843 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.521812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j"] Jul 06 20:26:03.586495 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.586464 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:03.589638 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.589617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6d66\" (UniqueName: \"kubernetes.io/projected/02a4200b-04e8-4e47-bc96-445f1d8d32e8-kube-api-access-q6d66\") pod \"migrator-d57d58cc9-w4w5j\" (UID: \"02a4200b-04e8-4e47-bc96-445f1d8d32e8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j" Jul 06 20:26:03.687315 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.687288 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:03.690283 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.690265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6d66\" (UniqueName: \"kubernetes.io/projected/02a4200b-04e8-4e47-bc96-445f1d8d32e8-kube-api-access-q6d66\") pod \"migrator-d57d58cc9-w4w5j\" (UID: \"02a4200b-04e8-4e47-bc96-445f1d8d32e8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j" Jul 06 20:26:03.690345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.690308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:03.690459 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:03.690444 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:26:03.690532 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:03.690462 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6cd647-p5pf2: secret "image-registry-tls" not found Jul 06 20:26:03.690532 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:03.690529 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls podName:deb3fdb5-3b14-4d63-a75f-fbb78929cf87 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:05.690503472 +0000 UTC m=+108.006826085 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls") pod "image-registry-54dc6cd647-p5pf2" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87") : secret "image-registry-tls" not found Jul 06 20:26:03.698697 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.698671 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6d66\" (UniqueName: \"kubernetes.io/projected/02a4200b-04e8-4e47-bc96-445f1d8d32e8-kube-api-access-q6d66\") pod \"migrator-d57d58cc9-w4w5j\" (UID: \"02a4200b-04e8-4e47-bc96-445f1d8d32e8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j" Jul 06 20:26:03.790247 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.790212 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:03.811094 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.811058 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j" Jul 06 20:26:03.944791 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:03.944760 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a4200b_04e8_4e47_bc96_445f1d8d32e8.slice/crio-87880276de8394c718c8761f773234a99238902bde29019319c73ace3a8a0e91 WatchSource:0}: Error finding container 87880276de8394c718c8761f773234a99238902bde29019319c73ace3a8a0e91: Status 404 returned error can't find the container with id 87880276de8394c718c8761f773234a99238902bde29019319c73ace3a8a0e91 Jul 06 20:26:03.945776 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:03.945752 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j"] Jul 06 20:26:04.093842 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:04.093748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:04.094244 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:04.093862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:04.094244 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:04.093934 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:20.093916584 +0000 UTC m=+122.410239178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : configmap references non-existent config key: service-ca.crt Jul 06 20:26:04.094244 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:04.094030 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 20:26:04.094244 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:04.094081 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs podName:c342d055-b73d-4b1a-8b64-165bd700bd79 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:20.094069602 +0000 UTC m=+122.410392196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs") pod "router-default-7c5764d8c-vljch" (UID: "c342d055-b73d-4b1a-8b64-165bd700bd79") : secret "router-metrics-certs-default" not found Jul 06 20:26:04.913232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:04.913196 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j" event={"ID":"02a4200b-04e8-4e47-bc96-445f1d8d32e8","Type":"ContainerStarted","Data":"87880276de8394c718c8761f773234a99238902bde29019319c73ace3a8a0e91"} Jul 06 20:26:05.346827 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.346802 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-w8jsj"] Jul 06 20:26:05.349060 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.349042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.352335 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.352311 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 20:26:05.352959 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.352941 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 20:26:05.352959 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.352948 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 20:26:05.353131 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.353111 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 20:26:05.353306 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.353293 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-75wbj\"" Jul 06 20:26:05.365632 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.365604 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-w8jsj"] Jul 06 20:26:05.403552 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.403515 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:05.469463 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.469427 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:05.506795 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.506762 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a2383a8-6409-44e8-a43e-48df5a1b0417-signing-key\") pod \"service-ca-758f599c5-w8jsj\" (UID: \"4a2383a8-6409-44e8-a43e-48df5a1b0417\") " pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.506952 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.506885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n69wd\" (UniqueName: \"kubernetes.io/projected/4a2383a8-6409-44e8-a43e-48df5a1b0417-kube-api-access-n69wd\") pod \"service-ca-758f599c5-w8jsj\" (UID: \"4a2383a8-6409-44e8-a43e-48df5a1b0417\") " pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.506952 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.506915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a2383a8-6409-44e8-a43e-48df5a1b0417-signing-cabundle\") pod \"service-ca-758f599c5-w8jsj\" (UID: \"4a2383a8-6409-44e8-a43e-48df5a1b0417\") " pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.608369 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.608291 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n69wd\" (UniqueName: \"kubernetes.io/projected/4a2383a8-6409-44e8-a43e-48df5a1b0417-kube-api-access-n69wd\") pod \"service-ca-758f599c5-w8jsj\" (UID: \"4a2383a8-6409-44e8-a43e-48df5a1b0417\") " pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.608369 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.608329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a2383a8-6409-44e8-a43e-48df5a1b0417-signing-cabundle\") pod \"service-ca-758f599c5-w8jsj\" (UID: \"4a2383a8-6409-44e8-a43e-48df5a1b0417\") " pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.608546 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.608393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a2383a8-6409-44e8-a43e-48df5a1b0417-signing-key\") pod \"service-ca-758f599c5-w8jsj\" (UID: \"4a2383a8-6409-44e8-a43e-48df5a1b0417\") " pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.609059 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.609035 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a2383a8-6409-44e8-a43e-48df5a1b0417-signing-cabundle\") pod \"service-ca-758f599c5-w8jsj\" (UID: \"4a2383a8-6409-44e8-a43e-48df5a1b0417\") " pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.610719 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.610690 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a2383a8-6409-44e8-a43e-48df5a1b0417-signing-key\") pod \"service-ca-758f599c5-w8jsj\" (UID: \"4a2383a8-6409-44e8-a43e-48df5a1b0417\") " pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.619471 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.619411 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n69wd\" (UniqueName: \"kubernetes.io/projected/4a2383a8-6409-44e8-a43e-48df5a1b0417-kube-api-access-n69wd\") pod \"service-ca-758f599c5-w8jsj\" (UID: \"4a2383a8-6409-44e8-a43e-48df5a1b0417\") " pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.709154 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.709114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:05.709304 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:05.709289 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:26:05.709344 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:05.709309 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6cd647-p5pf2: secret "image-registry-tls" not found Jul 06 20:26:05.709382 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:05.709376 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls podName:deb3fdb5-3b14-4d63-a75f-fbb78929cf87 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:09.709359694 +0000 UTC m=+112.025682290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls") pod "image-registry-54dc6cd647-p5pf2" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87") : secret "image-registry-tls" not found Jul 06 20:26:05.718058 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.718027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-w8jsj" Jul 06 20:26:05.782402 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.782358 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:05.840962 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.840932 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-w8jsj"] Jul 06 20:26:05.843925 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:05.843901 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2383a8_6409_44e8_a43e_48df5a1b0417.slice/crio-9de8b33945861400bb6234a2497819d3d96856aae27b8b420dd881287691e7ec WatchSource:0}: Error finding container 9de8b33945861400bb6234a2497819d3d96856aae27b8b420dd881287691e7ec: Status 404 returned error can't find the container with id 9de8b33945861400bb6234a2497819d3d96856aae27b8b420dd881287691e7ec Jul 06 20:26:05.917760 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.917656 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j" event={"ID":"02a4200b-04e8-4e47-bc96-445f1d8d32e8","Type":"ContainerStarted","Data":"eac29f64bcd78e577f68edecc0897582046ec5a8fec9461c461d324df91a74e2"} Jul 06 20:26:05.917760 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.917735 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j" event={"ID":"02a4200b-04e8-4e47-bc96-445f1d8d32e8","Type":"ContainerStarted","Data":"d30a10a4e63f6705864ee2c6b9c0cbd9e9d1ce62abcea99ebd0ade7a3191cad2"} Jul 06 20:26:05.919082 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.919053 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-w8jsj" event={"ID":"4a2383a8-6409-44e8-a43e-48df5a1b0417","Type":"ContainerStarted","Data":"9de8b33945861400bb6234a2497819d3d96856aae27b8b420dd881287691e7ec"} Jul 06 20:26:05.935545 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:05.935491 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-w4w5j" podStartSLOduration=1.545630982 podStartE2EDuration="2.935476551s" totalImagesPullingTime="1.389845569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:05.934745025 +0000 UTC m=+108.251067640" watchObservedRunningTime="2026-07-06 20:26:05.935476551 +0000 UTC m=+108.251799167" Jul 06 20:26:06.028106 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:06.028074 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:06.124943 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:06.124904 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:07.707241 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:07.707206 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:08.331232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:08.331201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:26:08.331405 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:08.331277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:26:08.331405 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:08.331363 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:26:08.331477 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:08.331426 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls podName:7f65429d-ab7a-4fef-8295-225348965095 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:24.331411174 +0000 UTC m=+126.647733773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jhtpl" (UID: "7f65429d-ab7a-4fef-8295-225348965095") : secret "insights-runtime-extractor-tls" not found Jul 06 20:26:08.331784 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:08.331768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f65429d-ab7a-4fef-8295-225348965095-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:26:08.934090 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:08.934054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-w8jsj" event={"ID":"4a2383a8-6409-44e8-a43e-48df5a1b0417","Type":"ContainerStarted","Data":"731cfe14d4e780797dcc5cb1910cee1e672a64ccc2921de7d5906e6772e533bc"} Jul 06 20:26:08.954651 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:08.954591 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-w8jsj" podStartSLOduration=1.852606521 podStartE2EDuration="3.954571113s" totalImagesPullingTime="2.101964592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:08.953836611 +0000 UTC m=+111.270159229" watchObservedRunningTime="2026-07-06 20:26:08.954571113 +0000 UTC m=+111.270893732" Jul 06 20:26:09.605512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:09.605475 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:09.743822 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:09.743779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:09.744023 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:09.743962 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:26:09.744023 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:09.743996 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54dc6cd647-p5pf2: secret "image-registry-tls" not found Jul 06 20:26:09.744106 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:09.744063 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls podName:deb3fdb5-3b14-4d63-a75f-fbb78929cf87 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:17.744042754 +0000 UTC m=+120.060365351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls") pod "image-registry-54dc6cd647-p5pf2" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87") : secret "image-registry-tls" not found Jul 06 20:26:09.789617 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:09.789577 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:09.891905 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:09.891821 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:09.993312 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:09.993267 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:10.910901 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:10.910867 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:11.164228 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:11.164141 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:11.503865 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:11.503775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:11.631179 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:11.631146 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:11.733518 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:11.733483 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:11.908119 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:11.908062 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:12.968747 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:12.968717 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:13.241891 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:13.241806 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:13.342460 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:13.342427 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:13.506880 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:13.506787 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:13.604866 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:13.604836 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:13.704804 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:13.704762 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:13.933849 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:13.933810 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:14.065418 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:14.065390 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:14.430873 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:14.430846 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:14.531567 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:14.531530 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:15.097170 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:15.097137 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:15.296257 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:15.296217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:15.493353 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:15.493271 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:15.699794 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:15.699737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:15.903472 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:15.903429 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:16.187044 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:16.186918 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:16.916456 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:16.916420 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:17.311043 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:17.311007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:17.500627 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:17.500593 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:17.695327 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:17.695234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:17.810615 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:17.810574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:17.812956 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:17.812928 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") pod \"image-registry-54dc6cd647-p5pf2\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:17.838996 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:17.838960 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:17.974095 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:17.974030 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54dc6cd647-p5pf2"] Jul 06 20:26:17.976629 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:17.976592 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb3fdb5_3b14_4d63_a75f_fbb78929cf87.slice/crio-561ff62f52a4f2e4079dadfe0f656e29d86af187e3f75464c185b249552e9369 WatchSource:0}: Error finding container 561ff62f52a4f2e4079dadfe0f656e29d86af187e3f75464c185b249552e9369: Status 404 returned error can't find the container with id 561ff62f52a4f2e4079dadfe0f656e29d86af187e3f75464c185b249552e9369 Jul 06 20:26:18.091667 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:18.091629 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:18.697007 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:18.696961 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:18.967176 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:18.967095 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" event={"ID":"deb3fdb5-3b14-4d63-a75f-fbb78929cf87","Type":"ContainerStarted","Data":"86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360"} Jul 06 20:26:18.967176 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:18.967167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" event={"ID":"deb3fdb5-3b14-4d63-a75f-fbb78929cf87","Type":"ContainerStarted","Data":"561ff62f52a4f2e4079dadfe0f656e29d86af187e3f75464c185b249552e9369"} Jul 06 20:26:18.967397 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:18.967253 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:18.995578 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:18.995522 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" podStartSLOduration=17.995505666 podStartE2EDuration="17.995505666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:18.994081941 +0000 UTC m=+121.310404557" watchObservedRunningTime="2026-07-06 20:26:18.995505666 +0000 UTC m=+121.311828281" Jul 06 20:26:19.339172 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:19.339130 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:19.523284 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:19.523242 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:19.729039 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:19.728931 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:19.905254 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:19.905219 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:20.128370 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.128336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:20.130286 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.130264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:20.130361 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.130322 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:20.130852 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.130835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342d055-b73d-4b1a-8b64-165bd700bd79-service-ca-bundle\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:20.132558 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.132534 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c342d055-b73d-4b1a-8b64-165bd700bd79-metrics-certs\") pod \"router-default-7c5764d8c-vljch\" (UID: \"c342d055-b73d-4b1a-8b64-165bd700bd79\") " pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:20.296182 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.296142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:20.395292 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.395222 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nzjrw\"" Jul 06 20:26:20.403264 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.403240 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:20.537859 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.537773 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c5764d8c-vljch"] Jul 06 20:26:20.540300 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:20.540268 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc342d055_b73d_4b1a_8b64_165bd700bd79.slice/crio-d6b1548c033668168c996749b1bceb9bb986b2f33bbf3a809e5efbd03f1632cd WatchSource:0}: Error finding container d6b1548c033668168c996749b1bceb9bb986b2f33bbf3a809e5efbd03f1632cd: Status 404 returned error can't find the container with id d6b1548c033668168c996749b1bceb9bb986b2f33bbf3a809e5efbd03f1632cd Jul 06 20:26:20.974144 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.974110 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c5764d8c-vljch" event={"ID":"c342d055-b73d-4b1a-8b64-165bd700bd79","Type":"ContainerStarted","Data":"3513c89438876088b033f2c5ebf31ea8706aee48bbc9add6c375fbefc8c04996"} Jul 06 20:26:20.974525 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.974164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c5764d8c-vljch" event={"ID":"c342d055-b73d-4b1a-8b64-165bd700bd79","Type":"ContainerStarted","Data":"d6b1548c033668168c996749b1bceb9bb986b2f33bbf3a809e5efbd03f1632cd"} Jul 06 20:26:20.994654 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:20.994607 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c5764d8c-vljch" podStartSLOduration=32.994590096 podStartE2EDuration="32.994590096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:20.993705292 +0000 UTC m=+123.310027910" watchObservedRunningTime="2026-07-06 20:26:20.994590096 +0000 UTC m=+123.310912712" Jul 06 20:26:21.404295 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:21.404257 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:21.406735 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:21.406707 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:21.977798 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:21.977773 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:21.979096 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:21.979075 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c5764d8c-vljch" Jul 06 20:26:22.701722 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:22.701660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:22.804057 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:22.804024 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:22.901725 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:22.901686 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:23.152077 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:23.152042 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:24.362330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:24.362275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:26:24.364522 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:24.364502 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f65429d-ab7a-4fef-8295-225348965095-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jhtpl\" (UID: \"7f65429d-ab7a-4fef-8295-225348965095\") " pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:26:24.627137 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:24.627052 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lmvxt\"" Jul 06 20:26:24.635141 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:24.635120 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jhtpl" Jul 06 20:26:24.782702 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:24.782671 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jhtpl"] Jul 06 20:26:24.786633 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:24.786603 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f65429d_ab7a_4fef_8295_225348965095.slice/crio-50e09c6916913ad784569c732f1e6a107fdf4103898206f12deefdba57c24f60 WatchSource:0}: Error finding container 50e09c6916913ad784569c732f1e6a107fdf4103898206f12deefdba57c24f60: Status 404 returned error can't find the container with id 50e09c6916913ad784569c732f1e6a107fdf4103898206f12deefdba57c24f60 Jul 06 20:26:24.987703 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:24.987617 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhtpl" event={"ID":"7f65429d-ab7a-4fef-8295-225348965095","Type":"ContainerStarted","Data":"50e09c6916913ad784569c732f1e6a107fdf4103898206f12deefdba57c24f60"} Jul 06 20:26:27.084045 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:27.083999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:26:27.086501 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:27.086473 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b559bb74-1c48-40b3-969e-020253e57e45-metrics-certs\") pod \"network-metrics-daemon-8nfpr\" (UID: \"b559bb74-1c48-40b3-969e-020253e57e45\") " pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:26:27.168473 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:27.168441 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qsjzg\"" Jul 06 20:26:27.176687 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:27.176651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8nfpr" Jul 06 20:26:27.704003 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:27.703955 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54dc6cd647-p5pf2"] Jul 06 20:26:27.911839 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:27.911801 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:28.008380 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:28.008267 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:28.744211 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:28.744187 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8nfpr"] Jul 06 20:26:28.747334 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:28.747305 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb559bb74_1c48_40b3_969e_020253e57e45.slice/crio-5948b2e27450d51bca0a0aba10d6f34f46a102ac63638960fa6effd2b1b70867 WatchSource:0}: Error finding container 5948b2e27450d51bca0a0aba10d6f34f46a102ac63638960fa6effd2b1b70867: Status 404 returned error can't find the container with id 5948b2e27450d51bca0a0aba10d6f34f46a102ac63638960fa6effd2b1b70867 Jul 06 20:26:29.006015 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:29.005913 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8nfpr" event={"ID":"b559bb74-1c48-40b3-969e-020253e57e45","Type":"ContainerStarted","Data":"5948b2e27450d51bca0a0aba10d6f34f46a102ac63638960fa6effd2b1b70867"} Jul 06 20:26:29.007387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:29.007359 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhtpl" event={"ID":"7f65429d-ab7a-4fef-8295-225348965095","Type":"ContainerStarted","Data":"46ecebcf5afcb7e120819c0c27c8b2cec50fef3da9ee1b50a637fb0c63817618"} Jul 06 20:26:29.464534 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:29.464498 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:29.565381 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:29.565348 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:30.014137 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:30.014049 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhtpl" event={"ID":"7f65429d-ab7a-4fef-8295-225348965095","Type":"ContainerStarted","Data":"50128e5782b8e59c93a03a895ed6d603ae513d17a6b668980226441bfbad5ddf"} Jul 06 20:26:31.020268 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:31.020234 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8nfpr" event={"ID":"b559bb74-1c48-40b3-969e-020253e57e45","Type":"ContainerStarted","Data":"69621a3cdb3450c1a89c27f296be4644a16f767390a0bfca55b0ec6714e2fcc5"} Jul 06 20:26:31.020717 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:31.020292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8nfpr" event={"ID":"b559bb74-1c48-40b3-969e-020253e57e45","Type":"ContainerStarted","Data":"292d2edc44c8de44a4c187d7f77dc2a6a0fac42c07f90dab1a0c13a5cad6552c"} Jul 06 20:26:31.040135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:31.040069 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8nfpr" podStartSLOduration=130.663865387 podStartE2EDuration="2m12.04004857s" totalImagesPullingTime="1.376183183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:31.038950541 +0000 UTC m=+133.355273158" watchObservedRunningTime="2026-07-06 20:26:31.04004857 +0000 UTC m=+133.356371187" Jul 06 20:26:31.147492 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:31.147432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:31.247335 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:31.247286 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:31.350492 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:31.350453 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:31.526228 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:31.526161 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:31.625249 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:31.625113 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:32.025306 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:32.025272 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jhtpl" event={"ID":"7f65429d-ab7a-4fef-8295-225348965095","Type":"ContainerStarted","Data":"7775c3c52378581e7fc1663ec286810b0abb73370764c734915a3019b842b016"} Jul 06 20:26:32.045914 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:32.045861 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jhtpl" podStartSLOduration=33.083648896 podStartE2EDuration="40.045840986s" totalImagesPullingTime="6.96219209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:25:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:32.045095214 +0000 UTC m=+134.361417829" watchObservedRunningTime="2026-07-06 20:26:32.045840986 +0000 UTC m=+134.362163601" Jul 06 20:26:32.529726 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:32.529689 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:32.926372 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:32.926324 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:32.994395 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:32.994359 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:33.316657 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:33.316626 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:35.636192 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:35.636156 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:37.709342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:37.709298 2579 patch_prober.go:28] interesting pod/image-registry-54dc6cd647-p5pf2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 20:26:37.709719 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:37.709361 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" podUID="deb3fdb5-3b14-4d63-a75f-fbb78929cf87" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 20:26:38.087853 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.087819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:38.180770 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.180741 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:38.302564 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.302525 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:38.362522 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.362441 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q"] Jul 06 20:26:38.364521 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.364505 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.368153 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.367694 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 20:26:38.368153 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.367738 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 20:26:38.368153 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.367755 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:26:38.368153 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.367704 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-f8q6s\"" Jul 06 20:26:38.368153 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.367761 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:26:38.368153 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.367965 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:26:38.368153 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.368061 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 20:26:38.381309 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.381280 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q"] Jul 06 20:26:38.387778 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.387748 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xnr6n"] Jul 06 20:26:38.390202 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.390182 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.392478 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.392455 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:26:38.392651 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.392627 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:26:38.392829 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.392813 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:26:38.393038 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.393019 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-glmh5\"" Jul 06 20:26:38.401870 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.401842 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:38.470817 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.470783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b66vp\" (UniqueName: \"kubernetes.io/projected/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-api-access-b66vp\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.470817 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.470821 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04b4087f-6c73-42ee-866a-bfc6f28609c1-root\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.471105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.470842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-wtmp\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.471105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.470865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04b4087f-6c73-42ee-866a-bfc6f28609c1-sys\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.471105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.470904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.471105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.470966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-textfile\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.471105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.471002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.471105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.471053 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1824d0d1-7017-4299-8ddf-a2400cd26d98-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.471105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.471100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.471440 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.471123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.471440 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.471145 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52kv2\" (UniqueName: \"kubernetes.io/projected/04b4087f-6c73-42ee-866a-bfc6f28609c1-kube-api-access-52kv2\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.471440 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.471181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.471440 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.471222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1824d0d1-7017-4299-8ddf-a2400cd26d98-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.471440 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.471242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-tls\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.471440 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.471264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04b4087f-6c73-42ee-866a-bfc6f28609c1-metrics-client-ca\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.473571 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.473534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:38.571672 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.571633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.571842 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.571688 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.571842 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.571727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52kv2\" (UniqueName: \"kubernetes.io/projected/04b4087f-6c73-42ee-866a-bfc6f28609c1-kube-api-access-52kv2\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.571842 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.571763 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.571842 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.571807 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1824d0d1-7017-4299-8ddf-a2400cd26d98-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.571842 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:38.571823 2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 06 20:26:38.571842 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.571834 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-tls\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.572165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.571866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04b4087f-6c73-42ee-866a-bfc6f28609c1-metrics-client-ca\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.572165 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:38.571895 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-tls podName:1824d0d1-7017-4299-8ddf-a2400cd26d98 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:39.071870432 +0000 UTC m=+141.388193031 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-49x5q" (UID: "1824d0d1-7017-4299-8ddf-a2400cd26d98") : secret "kube-state-metrics-tls" not found Jul 06 20:26:38.572165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.571933 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b66vp\" (UniqueName: \"kubernetes.io/projected/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-api-access-b66vp\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.572165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.571969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04b4087f-6c73-42ee-866a-bfc6f28609c1-root\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.572165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.572015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-wtmp\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.572165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.572047 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04b4087f-6c73-42ee-866a-bfc6f28609c1-sys\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.572165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.572070 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.572165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.572106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-textfile\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.572165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.572137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.572596 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.572193 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1824d0d1-7017-4299-8ddf-a2400cd26d98-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.572596 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.572466 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04b4087f-6c73-42ee-866a-bfc6f28609c1-metrics-client-ca\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.572596 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.572575 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1824d0d1-7017-4299-8ddf-a2400cd26d98-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.574388 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.572841 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/04b4087f-6c73-42ee-866a-bfc6f28609c1-root\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.574388 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.573007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-wtmp\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.574388 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.573052 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/04b4087f-6c73-42ee-866a-bfc6f28609c1-sys\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.574388 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.573653 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.574388 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.573721 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-accelerators-collector-config\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.574388 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.573965 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-textfile\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.574388 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:38.574108 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 20:26:38.574388 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:38.574155 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-tls podName:04b4087f-6c73-42ee-866a-bfc6f28609c1 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:39.074138562 +0000 UTC m=+141.390461157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-tls") pod "node-exporter-xnr6n" (UID: "04b4087f-6c73-42ee-866a-bfc6f28609c1") : secret "node-exporter-tls" not found Jul 06 20:26:38.574869 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.574409 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1824d0d1-7017-4299-8ddf-a2400cd26d98-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.574869 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.574626 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.575558 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.575480 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:38.576311 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.576289 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.587000 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.586262 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b66vp\" (UniqueName: \"kubernetes.io/projected/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-api-access-b66vp\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:38.589761 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.589723 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52kv2\" (UniqueName: \"kubernetes.io/projected/04b4087f-6c73-42ee-866a-bfc6f28609c1-kube-api-access-52kv2\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:38.674509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.674414 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:38.775658 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.775620 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:38.874458 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:38.874401 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:39.076206 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.076171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-tls\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:39.076389 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.076285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:39.078481 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.078446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/04b4087f-6c73-42ee-866a-bfc6f28609c1-node-exporter-tls\") pod \"node-exporter-xnr6n\" (UID: \"04b4087f-6c73-42ee-866a-bfc6f28609c1\") " pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:39.078736 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.078713 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1824d0d1-7017-4299-8ddf-a2400cd26d98-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-49x5q\" (UID: \"1824d0d1-7017-4299-8ddf-a2400cd26d98\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:39.233583 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.233546 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:39.276118 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.276082 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" Jul 06 20:26:39.299460 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.299426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xnr6n" Jul 06 20:26:39.316958 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:39.316926 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b4087f_6c73_42ee_866a_bfc6f28609c1.slice/crio-9704a24e5572b6d85bb5b1c8305aa08ee6b42ed8b80abce684b09aa4f8b02899 WatchSource:0}: Error finding container 9704a24e5572b6d85bb5b1c8305aa08ee6b42ed8b80abce684b09aa4f8b02899: Status 404 returned error can't find the container with id 9704a24e5572b6d85bb5b1c8305aa08ee6b42ed8b80abce684b09aa4f8b02899 Jul 06 20:26:39.333881 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.333761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:39.429188 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.429154 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q"] Jul 06 20:26:39.432907 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:39.432881 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1824d0d1_7017_4299_8ddf_a2400cd26d98.slice/crio-bf664232599ece1c56272c6c64a2b1f0719f8fc6bc02ae5c564ba4a790a7ac55 WatchSource:0}: Error finding container bf664232599ece1c56272c6c64a2b1f0719f8fc6bc02ae5c564ba4a790a7ac55: Status 404 returned error can't find the container with id bf664232599ece1c56272c6c64a2b1f0719f8fc6bc02ae5c564ba4a790a7ac55 Jul 06 20:26:39.437643 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.437621 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:26:39.443035 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.443008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:39.443035 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.443024 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.446367 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.446346 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:26:39.447234 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.447213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:26:39.447699 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.447676 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:26:39.447812 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.447793 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:26:39.447877 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.447818 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bqp8c\"" Jul 06 20:26:39.448079 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.448064 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:26:39.448826 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.448804 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:26:39.449397 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.449378 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:26:39.449490 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.449382 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:26:39.451205 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.451188 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:26:39.467565 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.467540 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:26:39.479154 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479312 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479312 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479201 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479312 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479312 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479291 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479482 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479482 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479482 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-web-config\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479482 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbbls\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-kube-api-access-mbbls\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479624 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479486 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-config-volume\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479624 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-config-out\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479624 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.479624 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.479558 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.561682 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.561646 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:39.580757 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.580727 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.580912 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.580777 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.580912 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.580803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.580912 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.580827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.580912 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.580869 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.580912 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.580898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.581183 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.580925 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.581183 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.580953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-web-config\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.581183 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.581006 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbbls\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-kube-api-access-mbbls\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.581183 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:39.581044 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-trusted-ca-bundle podName:353a2370-34d8-44d5-a53c-b61c22721a70 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:40.081023797 +0000 UTC m=+142.397346391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70") : configmap references non-existent config key: ca-bundle.crt Jul 06 20:26:39.581183 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.581069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-config-volume\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.581183 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.581092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-config-out\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.581183 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.581118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.581183 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.581153 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.581630 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:39.581260 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 20:26:39.581630 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:39.581302 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-main-tls podName:353a2370-34d8-44d5-a53c-b61c22721a70 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:40.081287988 +0000 UTC m=+142.397610597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70") : secret "alertmanager-main-tls" not found Jul 06 20:26:39.581630 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.581570 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.582180 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.582152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.584235 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.583854 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-config-out\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.584235 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.584159 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.584235 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.584167 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.584493 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.584475 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-tls-assets\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.584571 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.584523 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.585256 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.585235 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-web-config\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.585516 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.585496 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-config-volume\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.586408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.586389 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.594207 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.594179 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbbls\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-kube-api-access-mbbls\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:39.663513 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:39.663477 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:40.057602 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:40.057559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" event={"ID":"1824d0d1-7017-4299-8ddf-a2400cd26d98","Type":"ContainerStarted","Data":"bf664232599ece1c56272c6c64a2b1f0719f8fc6bc02ae5c564ba4a790a7ac55"} Jul 06 20:26:40.059048 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:40.058972 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnr6n" event={"ID":"04b4087f-6c73-42ee-866a-bfc6f28609c1","Type":"ContainerStarted","Data":"9704a24e5572b6d85bb5b1c8305aa08ee6b42ed8b80abce684b09aa4f8b02899"} Jul 06 20:26:40.084688 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:40.084652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:40.084849 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:40.084744 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:40.085700 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:40.085672 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:40.087209 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:40.087186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:40.353862 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:40.353836 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:26:40.805863 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:40.805829 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:26:40.809469 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:40.809430 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353a2370_34d8_44d5_a53c_b61c22721a70.slice/crio-fbc6c00161beb42f408f978e49e3dd8a6a4a64fc55c45648f34dd5d7f7eda1fe WatchSource:0}: Error finding container fbc6c00161beb42f408f978e49e3dd8a6a4a64fc55c45648f34dd5d7f7eda1fe: Status 404 returned error can't find the container with id fbc6c00161beb42f408f978e49e3dd8a6a4a64fc55c45648f34dd5d7f7eda1fe Jul 06 20:26:41.064318 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.064283 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerStarted","Data":"fbc6c00161beb42f408f978e49e3dd8a6a4a64fc55c45648f34dd5d7f7eda1fe"} Jul 06 20:26:41.066595 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.066035 2579 generic.go:356] "Generic (PLEG): container finished" podID="04b4087f-6c73-42ee-866a-bfc6f28609c1" containerID="7877be11535ce5bd670681095c1816aedfb49950f9815df604dd9d5c937ed16a" exitCode=0 Jul 06 20:26:41.066595 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.066132 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnr6n" event={"ID":"04b4087f-6c73-42ee-866a-bfc6f28609c1","Type":"ContainerDied","Data":"7877be11535ce5bd670681095c1816aedfb49950f9815df604dd9d5c937ed16a"} Jul 06 20:26:41.068997 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.068946 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" event={"ID":"1824d0d1-7017-4299-8ddf-a2400cd26d98","Type":"ContainerStarted","Data":"4bfa2e7c84c02916b1a6ff6023897e239baea91675922c3c3c158f5cf94efa4b"} Jul 06 20:26:41.069124 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.069025 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" event={"ID":"1824d0d1-7017-4299-8ddf-a2400cd26d98","Type":"ContainerStarted","Data":"2ca4e7be44d89a53e285b402906b2b50fd101788edd16e4a007d047500a80e12"} Jul 06 20:26:41.069124 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.069059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" event={"ID":"1824d0d1-7017-4299-8ddf-a2400cd26d98","Type":"ContainerStarted","Data":"a87bc3232c23c1fab5b4cee438487d4451cacabbe33f6b3f395be45be9775e73"} Jul 06 20:26:41.105041 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.104990 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-49x5q" podStartSLOduration=1.814874105 podStartE2EDuration="3.104959373s" totalImagesPullingTime="1.290085268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:41.103732122 +0000 UTC m=+143.420054740" watchObservedRunningTime="2026-07-06 20:26:41.104959373 +0000 UTC m=+143.421281989" Jul 06 20:26:41.311767 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.311734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:41.360641 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.360609 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c4f554887-5hzjv"] Jul 06 20:26:41.364640 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.364612 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.367606 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.367549 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 20:26:41.368081 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.368060 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 20:26:41.368178 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.368067 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cm6f36cv00p33\"" Jul 06 20:26:41.368480 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.368463 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 20:26:41.368832 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.368809 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n89j6\"" Jul 06 20:26:41.368939 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.368855 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 20:26:41.368939 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.368871 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 20:26:41.380638 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.380613 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c4f554887-5hzjv"] Jul 06 20:26:41.395697 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.395663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.395857 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.395749 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.395857 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.395777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-grpc-tls\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.395857 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.395800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwg48\" (UniqueName: \"kubernetes.io/projected/45a18eba-f174-41d4-99d9-2089a72182ab-kube-api-access-hwg48\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.395857 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.395827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-tls\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.395857 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.395851 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.396094 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.395884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.396094 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.395910 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a18eba-f174-41d4-99d9-2089a72182ab-metrics-client-ca\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.401808 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.401779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:41.468093 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.467993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:41.496744 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.496705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-tls\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.496744 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.496741 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.497023 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.496770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.497023 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.496788 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a18eba-f174-41d4-99d9-2089a72182ab-metrics-client-ca\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.497023 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.496839 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.497023 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.496882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.497023 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.496905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-grpc-tls\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.497023 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.496931 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwg48\" (UniqueName: \"kubernetes.io/projected/45a18eba-f174-41d4-99d9-2089a72182ab-kube-api-access-hwg48\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.497701 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.497670 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45a18eba-f174-41d4-99d9-2089a72182ab-metrics-client-ca\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.499931 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.499899 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.500082 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.500017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-grpc-tls\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.500082 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.500016 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.500082 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.500045 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.500218 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.500104 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-tls\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.500218 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.500133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/45a18eba-f174-41d4-99d9-2089a72182ab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.504790 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.504768 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwg48\" (UniqueName: \"kubernetes.io/projected/45a18eba-f174-41d4-99d9-2089a72182ab-kube-api-access-hwg48\") pod \"thanos-querier-7c4f554887-5hzjv\" (UID: \"45a18eba-f174-41d4-99d9-2089a72182ab\") " pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.538632 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.538589 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:41.676227 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.676189 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:41.982537 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:41.982510 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c4f554887-5hzjv"] Jul 06 20:26:42.007776 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:42.007738 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a18eba_f174_41d4_99d9_2089a72182ab.slice/crio-4ebc1758bd361944f94e704012fd991803e590b95f134f12791c638085240cc0 WatchSource:0}: Error finding container 4ebc1758bd361944f94e704012fd991803e590b95f134f12791c638085240cc0: Status 404 returned error can't find the container with id 4ebc1758bd361944f94e704012fd991803e590b95f134f12791c638085240cc0 Jul 06 20:26:42.074319 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.074281 2579 generic.go:356] "Generic (PLEG): container finished" podID="353a2370-34d8-44d5-a53c-b61c22721a70" containerID="a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966" exitCode=0 Jul 06 20:26:42.074708 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.074364 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerDied","Data":"a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966"} Jul 06 20:26:42.076746 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.076717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnr6n" event={"ID":"04b4087f-6c73-42ee-866a-bfc6f28609c1","Type":"ContainerStarted","Data":"04b06989ee1ce8e727938e2ddb23c60ff1f8836ff696cbad1d41e4420dc399a4"} Jul 06 20:26:42.076854 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.076779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xnr6n" event={"ID":"04b4087f-6c73-42ee-866a-bfc6f28609c1","Type":"ContainerStarted","Data":"af915ff2d2ab7307815f23a0550f2cfa10722fdfacb3b0df1703e718b0d6dbd7"} Jul 06 20:26:42.077915 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.077892 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" event={"ID":"45a18eba-f174-41d4-99d9-2089a72182ab","Type":"ContainerStarted","Data":"4ebc1758bd361944f94e704012fd991803e590b95f134f12791c638085240cc0"} Jul 06 20:26:42.121857 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.121749 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xnr6n" podStartSLOduration=3.0402394 podStartE2EDuration="4.12172897s" totalImagesPullingTime="1.007890014s" totalInitContainerRuntime="73.599556ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:42.119928023 +0000 UTC m=+144.436250633" watchObservedRunningTime="2026-07-06 20:26:42.12172897 +0000 UTC m=+144.438051586" Jul 06 20:26:42.921046 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.921011 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c6685b468-rxk7q"] Jul 06 20:26:42.924778 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.924748 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:42.928073 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.928045 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-83ibgdp47cmti\"" Jul 06 20:26:42.928219 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.928093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 20:26:42.928219 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.928105 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rgt8f\"" Jul 06 20:26:42.928219 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.928093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 20:26:42.928219 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.928051 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 20:26:42.928219 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.928102 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 20:26:42.941672 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:42.941648 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c6685b468-rxk7q"] Jul 06 20:26:43.008944 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.008907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-audit-log\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.009138 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.008963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sg4x\" (UniqueName: \"kubernetes.io/projected/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-kube-api-access-8sg4x\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.009138 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.009006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-secret-metrics-server-client-certs\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.009138 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.009071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.009138 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.009107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-secret-metrics-server-tls\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.009315 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.009150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-metrics-server-audit-profiles\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.009315 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.009176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-client-ca-bundle\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.110064 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.110023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sg4x\" (UniqueName: \"kubernetes.io/projected/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-kube-api-access-8sg4x\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.110622 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.110085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-secret-metrics-server-client-certs\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.110622 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.110140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.110622 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.110176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-secret-metrics-server-tls\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.110622 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.110236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-metrics-server-audit-profiles\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.110622 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.110260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-client-ca-bundle\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.110622 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.110304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-audit-log\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.117147 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.112509 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-metrics-server-audit-profiles\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.117147 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.113946 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-secret-metrics-server-client-certs\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.117147 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.113963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.117147 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.117093 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-audit-log\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.121318 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.119081 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7"] Jul 06 20:26:43.121318 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.119752 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:43.123288 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.121953 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-secret-metrics-server-tls\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.124891 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.124272 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sg4x\" (UniqueName: \"kubernetes.io/projected/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-kube-api-access-8sg4x\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.125507 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.125450 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25-client-ca-bundle\") pod \"metrics-server-c6685b468-rxk7q\" (UID: \"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25\") " pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.130294 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.130258 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7"] Jul 06 20:26:43.130405 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.130374 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:43.132919 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.132881 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 20:26:43.133522 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.133398 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-q5hxn\"" Jul 06 20:26:43.211816 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.211736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zpn7\" (UniqueName: \"kubernetes.io/projected/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-kube-api-access-7zpn7\") pod \"monitoring-plugin-d5dcff7cf-l9wr7\" (UID: \"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:43.212000 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.211839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l9wr7\" (UID: \"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:43.237068 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.236826 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:26:43.313048 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.313000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zpn7\" (UniqueName: \"kubernetes.io/projected/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-kube-api-access-7zpn7\") pod \"monitoring-plugin-d5dcff7cf-l9wr7\" (UID: \"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:43.313231 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.313092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l9wr7\" (UID: \"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:43.313291 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:43.313235 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 20:26:43.313338 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:43.313328 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-monitoring-plugin-cert podName:bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:43.813279856 +0000 UTC m=+146.129602475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-l9wr7" (UID: "bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7") : secret "monitoring-plugin-cert" not found Jul 06 20:26:43.321936 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.321905 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zpn7\" (UniqueName: \"kubernetes.io/projected/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-kube-api-access-7zpn7\") pod \"monitoring-plugin-d5dcff7cf-l9wr7\" (UID: \"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:43.392617 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.392529 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c6685b468-rxk7q"] Jul 06 20:26:43.396887 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:43.396854 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2eaca8_a0e6_4838_b4e7_58bd1d7aeb25.slice/crio-f79462fe08a7eb59edf8c3150eebc56d8943d79abac14db73b3d3af4faeb0409 WatchSource:0}: Error finding container f79462fe08a7eb59edf8c3150eebc56d8943d79abac14db73b3d3af4faeb0409: Status 404 returned error can't find the container with id f79462fe08a7eb59edf8c3150eebc56d8943d79abac14db73b3d3af4faeb0409 Jul 06 20:26:43.818811 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.818774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l9wr7\" (UID: \"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:43.819092 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:43.818942 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 20:26:43.819092 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:43.819034 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-monitoring-plugin-cert podName:bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7 nodeName:}" failed. No retries permitted until 2026-07-06 20:26:44.819013167 +0000 UTC m=+147.135335778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-l9wr7" (UID: "bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7") : secret "monitoring-plugin-cert" not found Jul 06 20:26:43.952193 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:43.952131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:44.090707 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.090620 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" event={"ID":"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25","Type":"ContainerStarted","Data":"f79462fe08a7eb59edf8c3150eebc56d8943d79abac14db73b3d3af4faeb0409"} Jul 06 20:26:44.585696 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.585445 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:26:44.588461 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.588412 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:44.594039 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.591335 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.594190 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.594051 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:26:44.594264 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.594211 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:26:44.594322 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.594271 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:26:44.596897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.595089 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:26:44.596897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.595156 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:26:44.596897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.595368 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:26:44.596897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.595453 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:26:44.596897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.595729 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:26:44.596897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.595897 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:26:44.596897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.596119 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:26:44.596897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.596755 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:26:44.598093 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.597567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-evek7hpsvjplu\"" Jul 06 20:26:44.598351 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.598268 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:26:44.598962 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.598750 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nlsn6\"" Jul 06 20:26:44.600076 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.599880 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:26:44.602797 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.602775 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:26:44.607500 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.607399 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:26:44.727493 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727634 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mxbb\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-kube-api-access-5mxbb\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727634 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727634 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727634 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727607 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-config\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727634 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727629 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727694 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727722 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727756 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727824 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.727908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727907 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.728347 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.727956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.728347 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.728011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.728347 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.728045 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.728347 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.728101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.728347 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.728125 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829437 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829404 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829437 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829591 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l9wr7\" (UID: \"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:44.829685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829685 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829801 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829882 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.829930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829907 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.830274 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.829954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.830274 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.830009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mxbb\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-kube-api-access-5mxbb\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.830274 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.830065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.830274 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.830096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.830274 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.830124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-config\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.830274 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.830148 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.830274 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.830179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.830633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.830293 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.830633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.830477 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.831222 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.830796 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.831775 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.831749 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.832096 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.832071 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.832455 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.832429 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.833914 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.833549 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.834032 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.833949 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.834491 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.834470 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.835777 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.835753 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.836138 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.836118 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.836412 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.836391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-l9wr7\" (UID: \"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:44.837272 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.836939 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.837272 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.836974 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.837272 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.837071 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.837272 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.837152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-config\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.837272 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.837181 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.837272 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.837226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-config-out\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.837521 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.837399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.837521 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.837464 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-web-config\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.839520 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.839500 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mxbb\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-kube-api-access-5mxbb\") pod \"prometheus-k8s-0\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.919684 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.919601 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:44.943356 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:44.943306 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:45.092736 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.092709 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:26:45.100351 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.100318 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerStarted","Data":"0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465"} Jul 06 20:26:45.100488 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.100397 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerStarted","Data":"a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547"} Jul 06 20:26:45.100488 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.100443 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerStarted","Data":"3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec"} Jul 06 20:26:45.100488 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.100478 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerStarted","Data":"9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91"} Jul 06 20:26:45.100706 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.100511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerStarted","Data":"59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae"} Jul 06 20:26:45.104623 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.104471 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" event={"ID":"45a18eba-f174-41d4-99d9-2089a72182ab","Type":"ContainerStarted","Data":"74d1a71dbbca6bc91aff3b638ae492baa75331823cba3871fea0fd166112b1c9"} Jul 06 20:26:45.104623 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.104543 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" event={"ID":"45a18eba-f174-41d4-99d9-2089a72182ab","Type":"ContainerStarted","Data":"242a8cd7099ba6e0550ef85d189f1e90d40230d7eb4d20bb6bddc6d681aadd71"} Jul 06 20:26:45.104623 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.104586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" event={"ID":"45a18eba-f174-41d4-99d9-2089a72182ab","Type":"ContainerStarted","Data":"24be0d43e5c0d8ce92b86c60d58316b0e8b25800151d4d91892ba2aab5b88be8"} Jul 06 20:26:45.105241 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:45.105185 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7"] Jul 06 20:26:45.404163 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:45.404133 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf8cf4a3_54f2_4d03_a3cf_ab20bb4fc2e7.slice/crio-f53e252bfdb9aa5f2959b05de6b79c9973a27ad7ec98806ceb3e1bfc739fd893 WatchSource:0}: Error finding container f53e252bfdb9aa5f2959b05de6b79c9973a27ad7ec98806ceb3e1bfc739fd893: Status 404 returned error can't find the container with id f53e252bfdb9aa5f2959b05de6b79c9973a27ad7ec98806ceb3e1bfc739fd893 Jul 06 20:26:45.405277 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:26:45.404958 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447db947_b579_48b5_a0ae_dc2882b596b7.slice/crio-b74f49040329700a44da977b40c407a6a39fd2ef8d39cf4a8ac5293ac5f96800 WatchSource:0}: Error finding container b74f49040329700a44da977b40c407a6a39fd2ef8d39cf4a8ac5293ac5f96800: Status 404 returned error can't find the container with id b74f49040329700a44da977b40c407a6a39fd2ef8d39cf4a8ac5293ac5f96800 Jul 06 20:26:46.110534 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.110494 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" event={"ID":"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7","Type":"ContainerStarted","Data":"f53e252bfdb9aa5f2959b05de6b79c9973a27ad7ec98806ceb3e1bfc739fd893"} Jul 06 20:26:46.114549 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.114522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerStarted","Data":"9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1"} Jul 06 20:26:46.117943 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.117917 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" event={"ID":"45a18eba-f174-41d4-99d9-2089a72182ab","Type":"ContainerStarted","Data":"f65520c72154557020a293c460313ce14ee24f36cf4cf2666b707dfe62d67e2c"} Jul 06 20:26:46.118060 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.118007 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" event={"ID":"45a18eba-f174-41d4-99d9-2089a72182ab","Type":"ContainerStarted","Data":"452af9ac449d0555d0967f6b801a17dbe9ed98ff14e17b0b39129690b5f759ec"} Jul 06 20:26:46.118060 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.118054 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" event={"ID":"45a18eba-f174-41d4-99d9-2089a72182ab","Type":"ContainerStarted","Data":"8c1dda49976ecc66f52418ed787e94b8413055ec0abe79a06f18dd89b7b398d6"} Jul 06 20:26:46.118156 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.118087 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:46.119485 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.119465 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" event={"ID":"df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25","Type":"ContainerStarted","Data":"0080bf29e1ec9f4d4de0d2e756d01f4cf9267a1fec2a9e09a556402c01f85f58"} Jul 06 20:26:46.120930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.120908 2579 generic.go:356] "Generic (PLEG): container finished" podID="447db947-b579-48b5-a0ae-dc2882b596b7" containerID="59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f" exitCode=0 Jul 06 20:26:46.121029 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.120939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerDied","Data":"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f"} Jul 06 20:26:46.121029 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.121004 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerStarted","Data":"b74f49040329700a44da977b40c407a6a39fd2ef8d39cf4a8ac5293ac5f96800"} Jul 06 20:26:46.147362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.147285 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9120850320000002 podStartE2EDuration="7.147264354s" totalImagesPullingTime="4.218685246s" totalInitContainerRuntime="16.494076ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:46.144783484 +0000 UTC m=+148.461106099" watchObservedRunningTime="2026-07-06 20:26:46.147264354 +0000 UTC m=+148.463586977" Jul 06 20:26:46.175099 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:46.175034 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" podStartSLOduration=1.804729794 podStartE2EDuration="5.175011526s" totalImagesPullingTime="3.370281732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:46.173174438 +0000 UTC m=+148.489497047" watchObservedRunningTime="2026-07-06 20:26:46.175011526 +0000 UTC m=+148.491334144" Jul 06 20:26:47.126716 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:47.126664 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" event={"ID":"bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7","Type":"ContainerStarted","Data":"96f1b5aab028643c0e5bf30203241ff3699ac7aca3ef347718573473e5c3f7dc"} Jul 06 20:26:47.127661 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:47.127629 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:47.131668 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:47.131645 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" Jul 06 20:26:47.154530 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:47.154473 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" podStartSLOduration=2.963635349 podStartE2EDuration="5.154450901s" totalImagesPullingTime="2.190815552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:46.235447794 +0000 UTC m=+148.551770411" watchObservedRunningTime="2026-07-06 20:26:47.154450901 +0000 UTC m=+149.470773524" Jul 06 20:26:47.186044 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:47.185931 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-l9wr7" podStartSLOduration=2.683179633 podStartE2EDuration="4.185910968s" totalImagesPullingTime="1.502731335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:47.159006684 +0000 UTC m=+149.475329294" watchObservedRunningTime="2026-07-06 20:26:47.185910968 +0000 UTC m=+149.502233583" Jul 06 20:26:47.709255 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:47.709215 2579 patch_prober.go:28] interesting pod/image-registry-54dc6cd647-p5pf2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 20:26:47.709445 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:47.709276 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" podUID="deb3fdb5-3b14-4d63-a75f-fbb78929cf87" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 20:26:49.247227 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:49.247182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:50.142047 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:50.142013 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerStarted","Data":"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15"} Jul 06 20:26:50.142216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:50.142098 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerStarted","Data":"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5"} Jul 06 20:26:50.142216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:50.142124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerStarted","Data":"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031"} Jul 06 20:26:50.142216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:50.142153 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerStarted","Data":"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df"} Jul 06 20:26:50.142216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:50.142176 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerStarted","Data":"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a"} Jul 06 20:26:50.142216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:50.142198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerStarted","Data":"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13"} Jul 06 20:26:50.174882 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:50.174814 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.011112573 podStartE2EDuration="6.174796327s" totalImagesPullingTime="3.130731445s" totalInitContainerRuntime="32.952309ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:26:50.173031564 +0000 UTC m=+152.489354177" watchObservedRunningTime="2026-07-06 20:26:50.174796327 +0000 UTC m=+152.491118943" Jul 06 20:26:51.127583 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:51.127547 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:51.227997 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:51.227945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:52.134771 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:52.134738 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c4f554887-5hzjv" Jul 06 20:26:52.725532 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:52.725469 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" podUID="deb3fdb5-3b14-4d63-a75f-fbb78929cf87" containerName="registry" containerID="cri-o://86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360" gracePeriod=30 Jul 06 20:26:52.988947 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:52.988885 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:53.116794 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.116746 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-installation-pull-secrets\") pod \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " Jul 06 20:26:53.116794 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.116792 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnlrg\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-kube-api-access-pnlrg\") pod \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " Jul 06 20:26:53.117067 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.116820 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-image-registry-private-configuration\") pod \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " Jul 06 20:26:53.117067 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.116900 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-certificates\") pod \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " Jul 06 20:26:53.117067 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.116957 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") pod \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " Jul 06 20:26:53.117067 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.117022 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-ca-trust-extracted\") pod \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " Jul 06 20:26:53.117067 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.117059 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-trusted-ca\") pod \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " Jul 06 20:26:53.117296 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.117083 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-bound-sa-token\") pod \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\" (UID: \"deb3fdb5-3b14-4d63-a75f-fbb78929cf87\") " Jul 06 20:26:53.117562 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.117349 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "deb3fdb5-3b14-4d63-a75f-fbb78929cf87" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:26:53.117842 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.117821 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "deb3fdb5-3b14-4d63-a75f-fbb78929cf87" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:26:53.119620 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.119589 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-kube-api-access-pnlrg" (OuterVolumeSpecName: "kube-api-access-pnlrg") pod "deb3fdb5-3b14-4d63-a75f-fbb78929cf87" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87"). InnerVolumeSpecName "kube-api-access-pnlrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:26:53.119620 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.119610 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "deb3fdb5-3b14-4d63-a75f-fbb78929cf87" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:26:53.119789 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.119692 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "deb3fdb5-3b14-4d63-a75f-fbb78929cf87" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:26:53.119789 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.119719 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "deb3fdb5-3b14-4d63-a75f-fbb78929cf87" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:26:53.119866 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.119822 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "deb3fdb5-3b14-4d63-a75f-fbb78929cf87" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:26:53.125781 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.125753 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "deb3fdb5-3b14-4d63-a75f-fbb78929cf87" (UID: "deb3fdb5-3b14-4d63-a75f-fbb78929cf87"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:26:53.159871 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.159838 2579 generic.go:356] "Generic (PLEG): container finished" podID="deb3fdb5-3b14-4d63-a75f-fbb78929cf87" containerID="86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360" exitCode=0 Jul 06 20:26:53.160277 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.159882 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" Jul 06 20:26:53.160277 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.159891 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" event={"ID":"deb3fdb5-3b14-4d63-a75f-fbb78929cf87","Type":"ContainerDied","Data":"86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360"} Jul 06 20:26:53.160277 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.159929 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54dc6cd647-p5pf2" event={"ID":"deb3fdb5-3b14-4d63-a75f-fbb78929cf87","Type":"ContainerDied","Data":"561ff62f52a4f2e4079dadfe0f656e29d86af187e3f75464c185b249552e9369"} Jul 06 20:26:53.160277 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.159947 2579 scope.go:117] "RemoveContainer" containerID="86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360" Jul 06 20:26:53.168760 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.168743 2579 scope.go:117] "RemoveContainer" containerID="86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360" Jul 06 20:26:53.169025 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:53.169005 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360\": container with ID starting with 86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360 not found: ID does not exist" containerID="86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360" Jul 06 20:26:53.169099 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.169039 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360"} err="failed to get container status \"86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360\": rpc error: code = NotFound desc = could not find container \"86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360\": container with ID starting with 86f3f9447162b61bfea0dbcdc04928c65e1b47360f44c8830e0e0d9383b83360 not found: ID does not exist" Jul 06 20:26:53.180804 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.180767 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54dc6cd647-p5pf2"] Jul 06 20:26:53.184631 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.184605 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54dc6cd647-p5pf2"] Jul 06 20:26:53.218038 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.218001 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-certificates\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:26:53.218038 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.218034 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-registry-tls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:26:53.218232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.218049 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-ca-trust-extracted\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:26:53.218232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.218060 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-trusted-ca\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:26:53.218232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.218071 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-bound-sa-token\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:26:53.218232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.218082 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-installation-pull-secrets\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:26:53.218232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.218092 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnlrg\" (UniqueName: \"kubernetes.io/projected/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-kube-api-access-pnlrg\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:26:53.218232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:53.218106 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deb3fdb5-3b14-4d63-a75f-fbb78929cf87-image-registry-private-configuration\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:26:54.461964 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:54.461928 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb3fdb5-3b14-4d63-a75f-fbb78929cf87" path="/var/lib/kubelet/pods/deb3fdb5-3b14-4d63-a75f-fbb78929cf87/volumes" Jul 06 20:26:54.726621 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:54.726531 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:54.825264 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:54.825230 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:54.920269 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:54.920230 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:26:54.924855 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:54.924823 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:55.024821 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:55.024737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:55.390736 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:55.390699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:55.796216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:55.796182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:56.051810 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:56.051728 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:56.124291 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:56.124256 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:56.401192 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:56.401109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:56.503260 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:56.503218 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:56.607127 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:56.607094 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:56.708579 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:56.708494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:56.995496 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:26:56.995390 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-c7sfk" podUID="f6c8eeb7-12f5-4594-b3ac-1c636928e609" Jul 06 20:26:57.176908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:57.176869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c7sfk" Jul 06 20:26:58.622839 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:58.622793 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:26:58.686147 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:26:58.686110 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:00.279216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:00.279177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:00.379177 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:00.379131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:01.512253 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:01.512201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:01.613894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:01.613863 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:01.897420 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:01.893513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:27:01.897420 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:01.896637 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f6c8eeb7-12f5-4594-b3ac-1c636928e609-metrics-tls\") pod \"dns-default-c7sfk\" (UID: \"f6c8eeb7-12f5-4594-b3ac-1c636928e609\") " pod="openshift-dns/dns-default-c7sfk" Jul 06 20:27:01.980602 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:01.980574 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qvcv5\"" Jul 06 20:27:01.988552 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:01.988532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c7sfk" Jul 06 20:27:02.304871 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:02.304841 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c7sfk"] Jul 06 20:27:02.307232 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:27:02.307195 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c8eeb7_12f5_4594_b3ac_1c636928e609.slice/crio-6f8c156d6fc8c20df5008f24d4d2ec37bbeb516d1d0144a6e4b6f2ba5383361a WatchSource:0}: Error finding container 6f8c156d6fc8c20df5008f24d4d2ec37bbeb516d1d0144a6e4b6f2ba5383361a: Status 404 returned error can't find the container with id 6f8c156d6fc8c20df5008f24d4d2ec37bbeb516d1d0144a6e4b6f2ba5383361a Jul 06 20:27:03.201519 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:03.201484 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c7sfk" event={"ID":"f6c8eeb7-12f5-4594-b3ac-1c636928e609","Type":"ContainerStarted","Data":"6f8c156d6fc8c20df5008f24d4d2ec37bbeb516d1d0144a6e4b6f2ba5383361a"} Jul 06 20:27:03.237969 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:03.237930 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:27:03.238138 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:03.238020 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:27:05.211360 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:05.211324 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c7sfk" event={"ID":"f6c8eeb7-12f5-4594-b3ac-1c636928e609","Type":"ContainerStarted","Data":"7dfd659c3877641448ac1f35d0f065beed17ad89b45810ab72f19cc8d81caff3"} Jul 06 20:27:05.211897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:05.211380 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c7sfk" event={"ID":"f6c8eeb7-12f5-4594-b3ac-1c636928e609","Type":"ContainerStarted","Data":"b2494efdef985fed4710fa8f8d2fa8b152bdf59c3d12367696e825580e1cb408"} Jul 06 20:27:05.211897 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:05.211416 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c7sfk" Jul 06 20:27:05.232616 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:05.230045 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c7sfk" podStartSLOduration=130.080798429 podStartE2EDuration="2m12.230023947s" totalImagesPullingTime="2.149225518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:27:05.227954759 +0000 UTC m=+167.544277377" watchObservedRunningTime="2026-07-06 20:27:05.230023947 +0000 UTC m=+167.546346563" Jul 06 20:27:05.435235 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:05.435201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:05.508370 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:05.508281 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:07.221328 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:07.221295 2579 generic.go:356] "Generic (PLEG): container finished" podID="2def55ac-aa00-467f-ac1f-2724be0c6f19" containerID="5f5da5fb178a72bc2b7e1e7fa9ffeefd4fb22af87ce896cd158c4359411f065a" exitCode=0 Jul 06 20:27:07.221725 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:07.221370 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" event={"ID":"2def55ac-aa00-467f-ac1f-2724be0c6f19","Type":"ContainerDied","Data":"5f5da5fb178a72bc2b7e1e7fa9ffeefd4fb22af87ce896cd158c4359411f065a"} Jul 06 20:27:07.221725 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:07.221690 2579 scope.go:117] "RemoveContainer" containerID="5f5da5fb178a72bc2b7e1e7fa9ffeefd4fb22af87ce896cd158c4359411f065a" Jul 06 20:27:08.227543 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:08.227510 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-pddnm" event={"ID":"2def55ac-aa00-467f-ac1f-2724be0c6f19","Type":"ContainerStarted","Data":"ed56808f78244dd23b48cfa088525758a07c6e02706109543da57bf1abed4af1"} Jul 06 20:27:08.318804 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:08.318761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:08.419336 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:08.419298 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:08.481383 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:08.481300 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:09.042001 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:09.041947 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c7sfk_f6c8eeb7-12f5-4594-b3ac-1c636928e609/dns/0.log" Jul 06 20:27:09.241825 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:09.241744 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c7sfk_f6c8eeb7-12f5-4594-b3ac-1c636928e609/kube-rbac-proxy/0.log" Jul 06 20:27:09.841934 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:09.841908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r792d_52d8bc32-2d42-49fb-9a90-d7403c5e6766/dns-node-resolver/0.log" Jul 06 20:27:10.042836 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:10.042812 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c5764d8c-vljch_c342d055-b73d-4b1a-8b64-165bd700bd79/router/0.log" Jul 06 20:27:10.641783 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:10.641711 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vsj4b_52e3233d-4675-4171-b69d-aabc47fb581c/serve-healthcheck-canary/0.log" Jul 06 20:27:11.825135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:11.825103 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:14.191993 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:14.191941 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:14.433917 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:14.433881 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:14.532036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:14.531924 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:14.607806 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:14.607767 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:15.218022 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:15.217971 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c7sfk" Jul 06 20:27:16.222975 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:16.222941 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:16.289397 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:16.289367 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:23.242828 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:23.242800 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:27:23.246576 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:23.246555 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c6685b468-rxk7q" Jul 06 20:27:23.583576 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:23.583537 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:23.684423 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:23.684385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:24.351920 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:24.351886 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:24.454616 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:24.454573 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:25.084372 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:25.084335 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:25.148194 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:25.148157 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:26.658312 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:26.658267 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:26.726214 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:26.726181 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:27.473252 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:27.473223 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:29.424214 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:29.424175 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:29.486324 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:29.486287 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:44.427537 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:44.427499 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:44.488918 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:44.488881 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:44.920273 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:44.920235 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:27:44.936034 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:44.936008 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:27:45.398481 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:45.398452 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:27:54.465283 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:54.465246 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:54.568430 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:54.568392 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:54.817923 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:54.817883 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:54.884408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:54.884372 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:27:58.739275 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:58.739240 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:27:58.739695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:58.739523 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="alertmanager" containerID="cri-o://59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae" gracePeriod=120 Jul 06 20:27:58.739695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:58.739588 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy-metric" containerID="cri-o://0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465" gracePeriod=120 Jul 06 20:27:58.739695 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:58.739643 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy-web" containerID="cri-o://3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec" gracePeriod=120 Jul 06 20:27:58.739855 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:58.739659 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="prom-label-proxy" containerID="cri-o://9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1" gracePeriod=120 Jul 06 20:27:58.739855 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:58.739678 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="config-reloader" containerID="cri-o://9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91" gracePeriod=120 Jul 06 20:27:58.739855 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:58.739686 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy" containerID="cri-o://a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547" gracePeriod=120 Jul 06 20:27:59.440894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:59.440864 2579 generic.go:356] "Generic (PLEG): container finished" podID="353a2370-34d8-44d5-a53c-b61c22721a70" containerID="9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1" exitCode=0 Jul 06 20:27:59.440894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:59.440887 2579 generic.go:356] "Generic (PLEG): container finished" podID="353a2370-34d8-44d5-a53c-b61c22721a70" containerID="a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547" exitCode=0 Jul 06 20:27:59.440894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:59.440894 2579 generic.go:356] "Generic (PLEG): container finished" podID="353a2370-34d8-44d5-a53c-b61c22721a70" containerID="9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91" exitCode=0 Jul 06 20:27:59.440894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:59.440899 2579 generic.go:356] "Generic (PLEG): container finished" podID="353a2370-34d8-44d5-a53c-b61c22721a70" containerID="59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae" exitCode=0 Jul 06 20:27:59.441178 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:59.440938 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerDied","Data":"9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1"} Jul 06 20:27:59.441178 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:59.441031 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerDied","Data":"a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547"} Jul 06 20:27:59.441178 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:59.441059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerDied","Data":"9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91"} Jul 06 20:27:59.441178 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:59.441085 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerDied","Data":"59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae"} Jul 06 20:27:59.990758 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:27:59.990734 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.008777 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.008745 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-config-out\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.008903 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.008798 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-web\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.008903 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.008826 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-main-tls\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.008903 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.008849 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-metrics-client-ca\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.008903 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.008881 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-web-config\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.009135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.008908 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-main-db\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.009135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.008945 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbbls\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-kube-api-access-mbbls\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.009135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.008999 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-trusted-ca-bundle\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.009135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.009038 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-metric\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.009135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.009075 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-tls-assets\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.009135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.009106 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-cluster-tls-config\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.009135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.009132 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.009466 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.009173 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-config-volume\") pod \"353a2370-34d8-44d5-a53c-b61c22721a70\" (UID: \"353a2370-34d8-44d5-a53c-b61c22721a70\") " Jul 06 20:28:00.009466 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.009279 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:28:00.009466 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.009456 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-metrics-client-ca\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.010454 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.010423 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:28:00.010657 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.010636 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:28:00.012178 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.012150 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-config-volume" (OuterVolumeSpecName: "config-volume") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:00.012323 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.012303 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-config-out" (OuterVolumeSpecName: "config-out") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:28:00.012390 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.012303 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:28:00.012446 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.012416 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-kube-api-access-mbbls" (OuterVolumeSpecName: "kube-api-access-mbbls") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "kube-api-access-mbbls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:28:00.012554 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.012520 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:00.013235 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.013195 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:00.013235 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.013212 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:00.013920 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.013893 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:00.017498 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.017451 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:00.025843 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.025805 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-web-config" (OuterVolumeSpecName: "web-config") pod "353a2370-34d8-44d5-a53c-b61c22721a70" (UID: "353a2370-34d8-44d5-a53c-b61c22721a70"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:00.110220 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110184 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110220 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110214 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110220 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110225 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-tls-assets\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110220 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110234 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-cluster-tls-config\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110243 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110252 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-config-volume\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110260 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-config-out\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110269 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110277 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-secret-alertmanager-main-tls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110288 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/353a2370-34d8-44d5-a53c-b61c22721a70-web-config\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110296 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/353a2370-34d8-44d5-a53c-b61c22721a70-alertmanager-main-db\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.110505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.110304 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbbls\" (UniqueName: \"kubernetes.io/projected/353a2370-34d8-44d5-a53c-b61c22721a70-kube-api-access-mbbls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:00.448045 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.447943 2579 generic.go:356] "Generic (PLEG): container finished" podID="353a2370-34d8-44d5-a53c-b61c22721a70" containerID="0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465" exitCode=0 Jul 06 20:28:00.448045 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.447995 2579 generic.go:356] "Generic (PLEG): container finished" podID="353a2370-34d8-44d5-a53c-b61c22721a70" containerID="3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec" exitCode=0 Jul 06 20:28:00.448045 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.448018 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerDied","Data":"0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465"} Jul 06 20:28:00.448045 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.448045 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.448280 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.448091 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerDied","Data":"3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec"} Jul 06 20:28:00.448280 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.448124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"353a2370-34d8-44d5-a53c-b61c22721a70","Type":"ContainerDied","Data":"fbc6c00161beb42f408f978e49e3dd8a6a4a64fc55c45648f34dd5d7f7eda1fe"} Jul 06 20:28:00.448280 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.448155 2579 scope.go:117] "RemoveContainer" containerID="9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1" Jul 06 20:28:00.459213 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.459187 2579 scope.go:117] "RemoveContainer" containerID="0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465" Jul 06 20:28:00.468130 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.468108 2579 scope.go:117] "RemoveContainer" containerID="a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547" Jul 06 20:28:00.476100 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.476074 2579 scope.go:117] "RemoveContainer" containerID="3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec" Jul 06 20:28:00.476647 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.476626 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:28:00.483337 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.483314 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:28:00.484158 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.484143 2579 scope.go:117] "RemoveContainer" containerID="9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91" Jul 06 20:28:00.491492 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.491472 2579 scope.go:117] "RemoveContainer" containerID="59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae" Jul 06 20:28:00.498621 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.498602 2579 scope.go:117] "RemoveContainer" containerID="a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966" Jul 06 20:28:00.506206 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.506188 2579 scope.go:117] "RemoveContainer" containerID="9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1" Jul 06 20:28:00.506461 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:00.506440 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1\": container with ID starting with 9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1 not found: ID does not exist" containerID="9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1" Jul 06 20:28:00.506509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.506470 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1"} err="failed to get container status \"9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1\": rpc error: code = NotFound desc = could not find container \"9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1\": container with ID starting with 9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1 not found: ID does not exist" Jul 06 20:28:00.506509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.506491 2579 scope.go:117] "RemoveContainer" containerID="0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465" Jul 06 20:28:00.506766 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:00.506749 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465\": container with ID starting with 0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465 not found: ID does not exist" containerID="0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465" Jul 06 20:28:00.506827 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.506772 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465"} err="failed to get container status \"0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465\": rpc error: code = NotFound desc = could not find container \"0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465\": container with ID starting with 0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465 not found: ID does not exist" Jul 06 20:28:00.506827 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.506788 2579 scope.go:117] "RemoveContainer" containerID="a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547" Jul 06 20:28:00.507039 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:00.507021 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547\": container with ID starting with a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547 not found: ID does not exist" containerID="a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547" Jul 06 20:28:00.507106 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.507044 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547"} err="failed to get container status \"a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547\": rpc error: code = NotFound desc = could not find container \"a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547\": container with ID starting with a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547 not found: ID does not exist" Jul 06 20:28:00.507106 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.507057 2579 scope.go:117] "RemoveContainer" containerID="3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec" Jul 06 20:28:00.507300 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:00.507279 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec\": container with ID starting with 3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec not found: ID does not exist" containerID="3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec" Jul 06 20:28:00.507346 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.507304 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec"} err="failed to get container status \"3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec\": rpc error: code = NotFound desc = could not find container \"3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec\": container with ID starting with 3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec not found: ID does not exist" Jul 06 20:28:00.507346 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.507318 2579 scope.go:117] "RemoveContainer" containerID="9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91" Jul 06 20:28:00.507550 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:00.507535 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91\": container with ID starting with 9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91 not found: ID does not exist" containerID="9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91" Jul 06 20:28:00.507602 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.507552 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91"} err="failed to get container status \"9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91\": rpc error: code = NotFound desc = could not find container \"9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91\": container with ID starting with 9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91 not found: ID does not exist" Jul 06 20:28:00.507602 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.507563 2579 scope.go:117] "RemoveContainer" containerID="59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae" Jul 06 20:28:00.507796 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:00.507780 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae\": container with ID starting with 59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae not found: ID does not exist" containerID="59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae" Jul 06 20:28:00.507833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.507803 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae"} err="failed to get container status \"59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae\": rpc error: code = NotFound desc = could not find container \"59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae\": container with ID starting with 59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae not found: ID does not exist" Jul 06 20:28:00.507833 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.507818 2579 scope.go:117] "RemoveContainer" containerID="a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966" Jul 06 20:28:00.508095 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:00.508079 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966\": container with ID starting with a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966 not found: ID does not exist" containerID="a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966" Jul 06 20:28:00.508156 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.508097 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966"} err="failed to get container status \"a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966\": rpc error: code = NotFound desc = could not find container \"a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966\": container with ID starting with a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966 not found: ID does not exist" Jul 06 20:28:00.508156 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.508109 2579 scope.go:117] "RemoveContainer" containerID="9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1" Jul 06 20:28:00.508339 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.508319 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1"} err="failed to get container status \"9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1\": rpc error: code = NotFound desc = could not find container \"9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1\": container with ID starting with 9d79517e4f830199c1d323af2b65e3c28f7bc2bda0b210716835aa9e2ef868c1 not found: ID does not exist" Jul 06 20:28:00.508380 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.508339 2579 scope.go:117] "RemoveContainer" containerID="0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465" Jul 06 20:28:00.508550 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.508531 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465"} err="failed to get container status \"0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465\": rpc error: code = NotFound desc = could not find container \"0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465\": container with ID starting with 0674d5b6029123dff9358e1046481df27b63010d897141759c685bccfc47f465 not found: ID does not exist" Jul 06 20:28:00.508594 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.508551 2579 scope.go:117] "RemoveContainer" containerID="a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547" Jul 06 20:28:00.508761 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.508743 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547"} err="failed to get container status \"a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547\": rpc error: code = NotFound desc = could not find container \"a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547\": container with ID starting with a9e30c49298d257293260562d16381146a5f1fa17d903693b170059e72cd2547 not found: ID does not exist" Jul 06 20:28:00.508802 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.508761 2579 scope.go:117] "RemoveContainer" containerID="3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec" Jul 06 20:28:00.509012 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.508995 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec"} err="failed to get container status \"3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec\": rpc error: code = NotFound desc = could not find container \"3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec\": container with ID starting with 3963d1c264e7f0727ea5a951593a389b8ebd839af4e85f08d29c1ff95b31a2ec not found: ID does not exist" Jul 06 20:28:00.509081 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.509013 2579 scope.go:117] "RemoveContainer" containerID="9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91" Jul 06 20:28:00.509236 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.509221 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91"} err="failed to get container status \"9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91\": rpc error: code = NotFound desc = could not find container \"9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91\": container with ID starting with 9b227040e2040319151fa543b5bd3aaf1136947b6af15ed53bdca43c83833e91 not found: ID does not exist" Jul 06 20:28:00.509287 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.509236 2579 scope.go:117] "RemoveContainer" containerID="59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae" Jul 06 20:28:00.509433 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.509418 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae"} err="failed to get container status \"59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae\": rpc error: code = NotFound desc = could not find container \"59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae\": container with ID starting with 59fbf277912e941beca5d1f6ac878c290f56e968465958f4da76779ae5ce0cae not found: ID does not exist" Jul 06 20:28:00.509480 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.509433 2579 scope.go:117] "RemoveContainer" containerID="a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966" Jul 06 20:28:00.509619 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.509598 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966"} err="failed to get container status \"a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966\": rpc error: code = NotFound desc = could not find container \"a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966\": container with ID starting with a0eea651466f89d63ff4b0080c7103c0a58c9d1237f0cb5b1dd6de9b2cc23966 not found: ID does not exist" Jul 06 20:28:00.511965 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.511946 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:28:00.512254 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512241 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="init-config-reloader" Jul 06 20:28:00.512307 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512256 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="init-config-reloader" Jul 06 20:28:00.512307 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512269 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy" Jul 06 20:28:00.512307 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512275 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy" Jul 06 20:28:00.512307 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512283 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy-metric" Jul 06 20:28:00.512307 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512289 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy-metric" Jul 06 20:28:00.512307 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512296 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="prom-label-proxy" Jul 06 20:28:00.512307 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512301 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="prom-label-proxy" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512311 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="config-reloader" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512316 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="config-reloader" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512321 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb3fdb5-3b14-4d63-a75f-fbb78929cf87" containerName="registry" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512327 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb3fdb5-3b14-4d63-a75f-fbb78929cf87" containerName="registry" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512336 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="alertmanager" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512341 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="alertmanager" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512350 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy-web" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512355 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy-web" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512401 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb3fdb5-3b14-4d63-a75f-fbb78929cf87" containerName="registry" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512409 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="config-reloader" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512416 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="prom-label-proxy" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512422 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy-metric" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512427 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy-web" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512433 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="kube-rbac-proxy" Jul 06 20:28:00.512512 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.512439 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" containerName="alertmanager" Jul 06 20:28:00.517575 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.517558 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.519858 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.519835 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:28:00.519944 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.519836 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:28:00.519944 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.519888 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:28:00.520276 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.520256 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:28:00.520355 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.520322 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:28:00.520355 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.520329 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:28:00.520584 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.520567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bqp8c\"" Jul 06 20:28:00.520649 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.520618 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:28:00.520649 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.520639 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:28:00.525796 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.525775 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:28:00.536868 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.536844 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:28:00.615245 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bee19023-958c-480a-ac9e-b2b786ada5e5-config-out\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615245 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615487 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615487 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee19023-958c-480a-ac9e-b2b786ada5e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615487 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615344 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615487 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615487 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s76pr\" (UniqueName: \"kubernetes.io/projected/bee19023-958c-480a-ac9e-b2b786ada5e5-kube-api-access-s76pr\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615487 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bee19023-958c-480a-ac9e-b2b786ada5e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615487 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bee19023-958c-480a-ac9e-b2b786ada5e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615718 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bee19023-958c-480a-ac9e-b2b786ada5e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615718 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-web-config\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615718 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.615718 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.615557 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.716713 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.716619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bee19023-958c-480a-ac9e-b2b786ada5e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.716713 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.716672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-web-config\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.716713 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.716691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717009 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.716720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717009 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.716753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bee19023-958c-480a-ac9e-b2b786ada5e5-config-out\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717009 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.716771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717009 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.716930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717009 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.717002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee19023-958c-480a-ac9e-b2b786ada5e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717264 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.717041 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717264 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.717068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717264 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.717092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s76pr\" (UniqueName: \"kubernetes.io/projected/bee19023-958c-480a-ac9e-b2b786ada5e5-kube-api-access-s76pr\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717264 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.717118 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bee19023-958c-480a-ac9e-b2b786ada5e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717264 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.717166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bee19023-958c-480a-ac9e-b2b786ada5e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.717532 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.717507 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bee19023-958c-480a-ac9e-b2b786ada5e5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.718428 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.718402 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bee19023-958c-480a-ac9e-b2b786ada5e5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.719970 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.719782 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.719970 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.719824 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.719970 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.719870 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bee19023-958c-480a-ac9e-b2b786ada5e5-config-out\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.719970 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.719919 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.719970 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.719954 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bee19023-958c-480a-ac9e-b2b786ada5e5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.720247 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.720035 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-web-config\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.720247 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.720108 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.720403 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.720387 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bee19023-958c-480a-ac9e-b2b786ada5e5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.720727 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.720712 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-config-volume\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.721711 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.721694 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bee19023-958c-480a-ac9e-b2b786ada5e5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.727703 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.727674 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s76pr\" (UniqueName: \"kubernetes.io/projected/bee19023-958c-480a-ac9e-b2b786ada5e5-kube-api-access-s76pr\") pod \"alertmanager-main-0\" (UID: \"bee19023-958c-480a-ac9e-b2b786ada5e5\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.827459 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.827426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:28:00.964857 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:00.964821 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:28:00.968546 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:28:00.968486 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee19023_958c_480a_ac9e_b2b786ada5e5.slice/crio-416c1b5aa7af514834b45f3fb2daa066ef179ee46c11177433d61febfb11c72c WatchSource:0}: Error finding container 416c1b5aa7af514834b45f3fb2daa066ef179ee46c11177433d61febfb11c72c: Status 404 returned error can't find the container with id 416c1b5aa7af514834b45f3fb2daa066ef179ee46c11177433d61febfb11c72c Jul 06 20:28:01.453092 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:01.453058 2579 generic.go:356] "Generic (PLEG): container finished" podID="bee19023-958c-480a-ac9e-b2b786ada5e5" containerID="21ca6c13d5455c04de76c4eb7d86dd90b9d2f2710e76150c37eed34af98b2398" exitCode=0 Jul 06 20:28:01.453515 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:01.453147 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bee19023-958c-480a-ac9e-b2b786ada5e5","Type":"ContainerDied","Data":"21ca6c13d5455c04de76c4eb7d86dd90b9d2f2710e76150c37eed34af98b2398"} Jul 06 20:28:01.453515 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:01.453227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bee19023-958c-480a-ac9e-b2b786ada5e5","Type":"ContainerStarted","Data":"416c1b5aa7af514834b45f3fb2daa066ef179ee46c11177433d61febfb11c72c"} Jul 06 20:28:02.466041 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.466005 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="353a2370-34d8-44d5-a53c-b61c22721a70" path="/var/lib/kubelet/pods/353a2370-34d8-44d5-a53c-b61c22721a70/volumes" Jul 06 20:28:02.466527 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.466507 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bee19023-958c-480a-ac9e-b2b786ada5e5","Type":"ContainerStarted","Data":"cf1a2c34e1905f6bad50ab43d941afbd8cbc41ccf1606b6228ff407e39c53249"} Jul 06 20:28:02.466594 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.466558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bee19023-958c-480a-ac9e-b2b786ada5e5","Type":"ContainerStarted","Data":"fb20d955276e2c3f0b321532d7f500ce9c0ba3494bd849daf61d82ddd0558efe"} Jul 06 20:28:02.466594 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.466585 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bee19023-958c-480a-ac9e-b2b786ada5e5","Type":"ContainerStarted","Data":"f8ea68c5cdb033b05da419b3dc41b683e22f869eebcccdca3dd71d61d637aec3"} Jul 06 20:28:02.466709 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.466609 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bee19023-958c-480a-ac9e-b2b786ada5e5","Type":"ContainerStarted","Data":"52a0a70dfb9f261ef91e4cfdad4a79ba42a3d0526be130023a6139e6a9584742"} Jul 06 20:28:02.466709 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.466633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bee19023-958c-480a-ac9e-b2b786ada5e5","Type":"ContainerStarted","Data":"72977567fde32d2cf7002b6312fa085f399682fd436eeda4bd84589482a33e5a"} Jul 06 20:28:02.466709 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.466655 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bee19023-958c-480a-ac9e-b2b786ada5e5","Type":"ContainerStarted","Data":"9a72ebdac1717f8db0c17fe7800e67a3b7c3c19a42f5513f6de7e0a43a1306cb"} Jul 06 20:28:02.495101 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.495044 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.477918382 podStartE2EDuration="2.495026832s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.10845ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:28:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:28:02.492788745 +0000 UTC m=+224.809111389" watchObservedRunningTime="2026-07-06 20:28:02.495026832 +0000 UTC m=+224.811349449" Jul 06 20:28:02.982124 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.982090 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:28:02.982447 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.982394 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="prometheus" containerID="cri-o://3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" gracePeriod=600 Jul 06 20:28:02.982543 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.982427 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy-web" containerID="cri-o://c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" gracePeriod=600 Jul 06 20:28:02.982543 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.982441 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="thanos-sidecar" containerID="cri-o://388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" gracePeriod=600 Jul 06 20:28:02.982543 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.982427 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy" containerID="cri-o://2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" gracePeriod=600 Jul 06 20:28:02.982543 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.982426 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" gracePeriod=600 Jul 06 20:28:02.982711 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:02.982449 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="config-reloader" containerID="cri-o://99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" gracePeriod=600 Jul 06 20:28:03.231014 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.230974 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.240826 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.240745 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-serving-certs-ca-bundle\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.240826 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.240794 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-kube-rbac-proxy\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.240826 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.240820 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-kubelet-serving-ca-bundle\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.241113 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.240847 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-grpc-tls\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.241113 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.240875 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-0\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.241113 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.240908 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-db\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.241113 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.240931 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.241113 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.240963 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.241113 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241010 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-tls-assets\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.241113 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241048 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-web-config\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.241469 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241308 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241567 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241627 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-metrics-client-certs\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241659 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-trusted-ca-bundle\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241831 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mxbb\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-kube-api-access-5mxbb\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241878 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-metrics-client-ca\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241916 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-2\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.241951 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-config-out\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.242584 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.242747 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-thanos-prometheus-http-client-file\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.242785 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-1\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.242818 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-config\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.242833 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.242846 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-tls\") pod \"447db947-b579-48b5-a0ae-dc2882b596b7\" (UID: \"447db947-b579-48b5-a0ae-dc2882b596b7\") " Jul 06 20:28:03.243111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.242855 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:28:03.244126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.243189 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-metrics-client-ca\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.244126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.243200 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:28:03.244126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.243210 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.244126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.243225 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.244126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.243241 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-db\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.244126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.243255 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.244126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.243478 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:28:03.244126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.243763 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:28:03.244994 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.244940 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:03.245152 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.245127 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:03.245447 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.245419 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:03.245796 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.245770 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:03.246176 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.246140 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:03.246383 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.246345 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-kube-api-access-5mxbb" (OuterVolumeSpecName: "kube-api-access-5mxbb") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "kube-api-access-5mxbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:28:03.246490 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.246411 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:03.246609 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.246591 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-config-out" (OuterVolumeSpecName: "config-out") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:28:03.246753 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.246716 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-config" (OuterVolumeSpecName: "config") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:03.246838 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.246786 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:28:03.246838 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.246795 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:03.256037 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.255995 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-web-config" (OuterVolumeSpecName: "web-config") pod "447db947-b579-48b5-a0ae-dc2882b596b7" (UID: "447db947-b579-48b5-a0ae-dc2882b596b7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:28:03.344173 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344136 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-web-config\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344173 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344168 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-metrics-client-certs\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344173 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344179 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mxbb\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-kube-api-access-5mxbb\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344188 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344204 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447db947-b579-48b5-a0ae-dc2882b596b7-config-out\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344216 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344227 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344237 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-config\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344246 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344255 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-kube-rbac-proxy\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344264 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-grpc-tls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344275 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/447db947-b579-48b5-a0ae-dc2882b596b7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344288 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344298 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447db947-b579-48b5-a0ae-dc2882b596b7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.344633 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.344306 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447db947-b579-48b5-a0ae-dc2882b596b7-tls-assets\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:28:03.472868 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.472828 2579 generic.go:356] "Generic (PLEG): container finished" podID="447db947-b579-48b5-a0ae-dc2882b596b7" containerID="3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" exitCode=0 Jul 06 20:28:03.472868 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.472857 2579 generic.go:356] "Generic (PLEG): container finished" podID="447db947-b579-48b5-a0ae-dc2882b596b7" containerID="2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" exitCode=0 Jul 06 20:28:03.472868 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.472866 2579 generic.go:356] "Generic (PLEG): container finished" podID="447db947-b579-48b5-a0ae-dc2882b596b7" containerID="c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" exitCode=0 Jul 06 20:28:03.472868 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.472872 2579 generic.go:356] "Generic (PLEG): container finished" podID="447db947-b579-48b5-a0ae-dc2882b596b7" containerID="388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" exitCode=0 Jul 06 20:28:03.472868 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.472878 2579 generic.go:356] "Generic (PLEG): container finished" podID="447db947-b579-48b5-a0ae-dc2882b596b7" containerID="99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" exitCode=0 Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.472883 2579 generic.go:356] "Generic (PLEG): container finished" podID="447db947-b579-48b5-a0ae-dc2882b596b7" containerID="3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" exitCode=0 Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.472912 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.472921 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerDied","Data":"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15"} Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.473022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerDied","Data":"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5"} Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.473050 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerDied","Data":"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031"} Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.473081 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerDied","Data":"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df"} Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.473087 2579 scope.go:117] "RemoveContainer" containerID="3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.473123 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerDied","Data":"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a"} Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.473164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerDied","Data":"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13"} Jul 06 20:28:03.473509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.473202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"447db947-b579-48b5-a0ae-dc2882b596b7","Type":"ContainerDied","Data":"b74f49040329700a44da977b40c407a6a39fd2ef8d39cf4a8ac5293ac5f96800"} Jul 06 20:28:03.481769 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.481750 2579 scope.go:117] "RemoveContainer" containerID="2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" Jul 06 20:28:03.489663 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.489644 2579 scope.go:117] "RemoveContainer" containerID="c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" Jul 06 20:28:03.500132 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.500106 2579 scope.go:117] "RemoveContainer" containerID="388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" Jul 06 20:28:03.500707 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.500620 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:28:03.502387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.502359 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:28:03.509188 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.509168 2579 scope.go:117] "RemoveContainer" containerID="99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" Jul 06 20:28:03.516546 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.516526 2579 scope.go:117] "RemoveContainer" containerID="3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" Jul 06 20:28:03.524084 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.524060 2579 scope.go:117] "RemoveContainer" containerID="59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f" Jul 06 20:28:03.531479 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.531460 2579 scope.go:117] "RemoveContainer" containerID="3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" Jul 06 20:28:03.531775 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:03.531755 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": container with ID starting with 3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15 not found: ID does not exist" containerID="3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" Jul 06 20:28:03.531844 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.531785 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15"} err="failed to get container status \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": rpc error: code = NotFound desc = could not find container \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": container with ID starting with 3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15 not found: ID does not exist" Jul 06 20:28:03.531844 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.531804 2579 scope.go:117] "RemoveContainer" containerID="2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" Jul 06 20:28:03.532076 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:03.532058 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": container with ID starting with 2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5 not found: ID does not exist" containerID="2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" Jul 06 20:28:03.532128 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.532082 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5"} err="failed to get container status \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": rpc error: code = NotFound desc = could not find container \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": container with ID starting with 2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5 not found: ID does not exist" Jul 06 20:28:03.532128 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.532101 2579 scope.go:117] "RemoveContainer" containerID="c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" Jul 06 20:28:03.532350 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:03.532332 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": container with ID starting with c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031 not found: ID does not exist" containerID="c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" Jul 06 20:28:03.532415 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.532362 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031"} err="failed to get container status \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": rpc error: code = NotFound desc = could not find container \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": container with ID starting with c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031 not found: ID does not exist" Jul 06 20:28:03.532415 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.532377 2579 scope.go:117] "RemoveContainer" containerID="388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" Jul 06 20:28:03.532730 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:03.532706 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": container with ID starting with 388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df not found: ID does not exist" containerID="388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" Jul 06 20:28:03.532885 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.532737 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df"} err="failed to get container status \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": rpc error: code = NotFound desc = could not find container \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": container with ID starting with 388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df not found: ID does not exist" Jul 06 20:28:03.532885 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.532757 2579 scope.go:117] "RemoveContainer" containerID="99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" Jul 06 20:28:03.533496 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:03.533472 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": container with ID starting with 99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a not found: ID does not exist" containerID="99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" Jul 06 20:28:03.533585 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.533502 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a"} err="failed to get container status \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": rpc error: code = NotFound desc = could not find container \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": container with ID starting with 99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a not found: ID does not exist" Jul 06 20:28:03.533585 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.533520 2579 scope.go:117] "RemoveContainer" containerID="3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" Jul 06 20:28:03.533814 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:03.533797 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": container with ID starting with 3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13 not found: ID does not exist" containerID="3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" Jul 06 20:28:03.533893 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.533817 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13"} err="failed to get container status \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": rpc error: code = NotFound desc = could not find container \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": container with ID starting with 3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13 not found: ID does not exist" Jul 06 20:28:03.533893 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.533833 2579 scope.go:117] "RemoveContainer" containerID="59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f" Jul 06 20:28:03.534169 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:28:03.534153 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": container with ID starting with 59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f not found: ID does not exist" containerID="59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f" Jul 06 20:28:03.534234 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.534171 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f"} err="failed to get container status \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": rpc error: code = NotFound desc = could not find container \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": container with ID starting with 59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f not found: ID does not exist" Jul 06 20:28:03.534234 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.534185 2579 scope.go:117] "RemoveContainer" containerID="3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" Jul 06 20:28:03.534439 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.534414 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15"} err="failed to get container status \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": rpc error: code = NotFound desc = could not find container \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": container with ID starting with 3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15 not found: ID does not exist" Jul 06 20:28:03.534490 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.534442 2579 scope.go:117] "RemoveContainer" containerID="2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" Jul 06 20:28:03.534706 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.534686 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5"} err="failed to get container status \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": rpc error: code = NotFound desc = could not find container \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": container with ID starting with 2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5 not found: ID does not exist" Jul 06 20:28:03.534757 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.534707 2579 scope.go:117] "RemoveContainer" containerID="c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" Jul 06 20:28:03.534810 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.534762 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:28:03.534923 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.534904 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031"} err="failed to get container status \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": rpc error: code = NotFound desc = could not find container \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": container with ID starting with c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031 not found: ID does not exist" Jul 06 20:28:03.534963 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.534934 2579 scope.go:117] "RemoveContainer" containerID="388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" Jul 06 20:28:03.535105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535092 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy" Jul 06 20:28:03.535149 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535108 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy" Jul 06 20:28:03.535149 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535118 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy-thanos" Jul 06 20:28:03.535149 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535127 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy-thanos" Jul 06 20:28:03.535149 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535129 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df"} err="failed to get container status \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": rpc error: code = NotFound desc = could not find container \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": container with ID starting with 388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df not found: ID does not exist" Jul 06 20:28:03.535149 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535140 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="init-config-reloader" Jul 06 20:28:03.535149 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535146 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="init-config-reloader" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535159 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy-web" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535165 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy-web" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535173 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="thanos-sidecar" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535179 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="thanos-sidecar" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535186 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="config-reloader" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535191 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="config-reloader" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535204 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="prometheus" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535208 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="prometheus" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535144 2579 scope.go:117] "RemoveContainer" containerID="99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535259 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="prometheus" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535268 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="config-reloader" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535275 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="thanos-sidecar" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535281 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy-web" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535288 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy-thanos" Jul 06 20:28:03.535362 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535299 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" containerName="kube-rbac-proxy" Jul 06 20:28:03.535867 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535427 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a"} err="failed to get container status \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": rpc error: code = NotFound desc = could not find container \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": container with ID starting with 99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a not found: ID does not exist" Jul 06 20:28:03.535867 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535439 2579 scope.go:117] "RemoveContainer" containerID="3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" Jul 06 20:28:03.535867 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535640 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13"} err="failed to get container status \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": rpc error: code = NotFound desc = could not find container \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": container with ID starting with 3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13 not found: ID does not exist" Jul 06 20:28:03.535867 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535652 2579 scope.go:117] "RemoveContainer" containerID="59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f" Jul 06 20:28:03.536084 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535867 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f"} err="failed to get container status \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": rpc error: code = NotFound desc = could not find container \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": container with ID starting with 59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f not found: ID does not exist" Jul 06 20:28:03.536084 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.535880 2579 scope.go:117] "RemoveContainer" containerID="3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" Jul 06 20:28:03.536206 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.536112 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15"} err="failed to get container status \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": rpc error: code = NotFound desc = could not find container \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": container with ID starting with 3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15 not found: ID does not exist" Jul 06 20:28:03.536206 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.536128 2579 scope.go:117] "RemoveContainer" containerID="2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" Jul 06 20:28:03.536382 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.536361 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5"} err="failed to get container status \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": rpc error: code = NotFound desc = could not find container \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": container with ID starting with 2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5 not found: ID does not exist" Jul 06 20:28:03.536451 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.536384 2579 scope.go:117] "RemoveContainer" containerID="c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" Jul 06 20:28:03.536629 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.536606 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031"} err="failed to get container status \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": rpc error: code = NotFound desc = could not find container \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": container with ID starting with c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031 not found: ID does not exist" Jul 06 20:28:03.536681 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.536632 2579 scope.go:117] "RemoveContainer" containerID="388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" Jul 06 20:28:03.536863 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.536842 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df"} err="failed to get container status \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": rpc error: code = NotFound desc = could not find container \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": container with ID starting with 388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df not found: ID does not exist" Jul 06 20:28:03.536863 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.536861 2579 scope.go:117] "RemoveContainer" containerID="99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" Jul 06 20:28:03.537084 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537068 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a"} err="failed to get container status \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": rpc error: code = NotFound desc = could not find container \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": container with ID starting with 99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a not found: ID does not exist" Jul 06 20:28:03.537084 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537084 2579 scope.go:117] "RemoveContainer" containerID="3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" Jul 06 20:28:03.537298 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537278 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13"} err="failed to get container status \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": rpc error: code = NotFound desc = could not find container \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": container with ID starting with 3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13 not found: ID does not exist" Jul 06 20:28:03.537298 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537297 2579 scope.go:117] "RemoveContainer" containerID="59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f" Jul 06 20:28:03.537505 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537481 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f"} err="failed to get container status \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": rpc error: code = NotFound desc = could not find container \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": container with ID starting with 59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f not found: ID does not exist" Jul 06 20:28:03.537554 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537506 2579 scope.go:117] "RemoveContainer" containerID="3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" Jul 06 20:28:03.537729 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537702 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15"} err="failed to get container status \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": rpc error: code = NotFound desc = could not find container \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": container with ID starting with 3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15 not found: ID does not exist" Jul 06 20:28:03.537729 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537723 2579 scope.go:117] "RemoveContainer" containerID="2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" Jul 06 20:28:03.537994 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537960 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5"} err="failed to get container status \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": rpc error: code = NotFound desc = could not find container \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": container with ID starting with 2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5 not found: ID does not exist" Jul 06 20:28:03.537994 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.537994 2579 scope.go:117] "RemoveContainer" containerID="c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" Jul 06 20:28:03.538214 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.538194 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031"} err="failed to get container status \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": rpc error: code = NotFound desc = could not find container \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": container with ID starting with c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031 not found: ID does not exist" Jul 06 20:28:03.538255 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.538215 2579 scope.go:117] "RemoveContainer" containerID="388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" Jul 06 20:28:03.538433 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.538416 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df"} err="failed to get container status \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": rpc error: code = NotFound desc = could not find container \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": container with ID starting with 388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df not found: ID does not exist" Jul 06 20:28:03.538491 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.538433 2579 scope.go:117] "RemoveContainer" containerID="99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" Jul 06 20:28:03.538631 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.538613 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a"} err="failed to get container status \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": rpc error: code = NotFound desc = could not find container \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": container with ID starting with 99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a not found: ID does not exist" Jul 06 20:28:03.538671 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.538633 2579 scope.go:117] "RemoveContainer" containerID="3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" Jul 06 20:28:03.538824 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.538805 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13"} err="failed to get container status \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": rpc error: code = NotFound desc = could not find container \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": container with ID starting with 3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13 not found: ID does not exist" Jul 06 20:28:03.538885 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.538826 2579 scope.go:117] "RemoveContainer" containerID="59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f" Jul 06 20:28:03.539058 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539040 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f"} err="failed to get container status \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": rpc error: code = NotFound desc = could not find container \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": container with ID starting with 59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f not found: ID does not exist" Jul 06 20:28:03.539111 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539058 2579 scope.go:117] "RemoveContainer" containerID="3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" Jul 06 20:28:03.539284 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539267 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15"} err="failed to get container status \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": rpc error: code = NotFound desc = could not find container \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": container with ID starting with 3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15 not found: ID does not exist" Jul 06 20:28:03.539328 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539284 2579 scope.go:117] "RemoveContainer" containerID="2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" Jul 06 20:28:03.539522 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539503 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5"} err="failed to get container status \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": rpc error: code = NotFound desc = could not find container \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": container with ID starting with 2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5 not found: ID does not exist" Jul 06 20:28:03.539559 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539523 2579 scope.go:117] "RemoveContainer" containerID="c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" Jul 06 20:28:03.539732 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539715 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031"} err="failed to get container status \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": rpc error: code = NotFound desc = could not find container \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": container with ID starting with c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031 not found: ID does not exist" Jul 06 20:28:03.539792 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539732 2579 scope.go:117] "RemoveContainer" containerID="388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" Jul 06 20:28:03.539940 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539921 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df"} err="failed to get container status \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": rpc error: code = NotFound desc = could not find container \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": container with ID starting with 388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df not found: ID does not exist" Jul 06 20:28:03.540036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.539941 2579 scope.go:117] "RemoveContainer" containerID="99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" Jul 06 20:28:03.540208 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.540192 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a"} err="failed to get container status \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": rpc error: code = NotFound desc = could not find container \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": container with ID starting with 99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a not found: ID does not exist" Jul 06 20:28:03.540208 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.540208 2579 scope.go:117] "RemoveContainer" containerID="3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" Jul 06 20:28:03.540425 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.540409 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13"} err="failed to get container status \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": rpc error: code = NotFound desc = could not find container \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": container with ID starting with 3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13 not found: ID does not exist" Jul 06 20:28:03.540425 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.540424 2579 scope.go:117] "RemoveContainer" containerID="59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f" Jul 06 20:28:03.540620 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.540606 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f"} err="failed to get container status \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": rpc error: code = NotFound desc = could not find container \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": container with ID starting with 59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f not found: ID does not exist" Jul 06 20:28:03.540665 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.540621 2579 scope.go:117] "RemoveContainer" containerID="3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15" Jul 06 20:28:03.540886 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.540870 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15"} err="failed to get container status \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": rpc error: code = NotFound desc = could not find container \"3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15\": container with ID starting with 3ba508dace0c0d8e388d0c01c939b9e511afbcdf94fc0face3d619dfeb779d15 not found: ID does not exist" Jul 06 20:28:03.540943 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.540890 2579 scope.go:117] "RemoveContainer" containerID="2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5" Jul 06 20:28:03.540943 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.540875 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.541369 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.541163 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5"} err="failed to get container status \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": rpc error: code = NotFound desc = could not find container \"2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5\": container with ID starting with 2e25b67c07134562cde620549d15417cdcf0fd2e0facc60de701219857938cf5 not found: ID does not exist" Jul 06 20:28:03.541369 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.541191 2579 scope.go:117] "RemoveContainer" containerID="c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031" Jul 06 20:28:03.541544 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.541520 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031"} err="failed to get container status \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": rpc error: code = NotFound desc = could not find container \"c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031\": container with ID starting with c4733d0623d2ba9cc7ab1b41c1c753cad9c99be4da2a68597625f061cbeba031 not found: ID does not exist" Jul 06 20:28:03.541544 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.541544 2579 scope.go:117] "RemoveContainer" containerID="388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df" Jul 06 20:28:03.541773 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.541752 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df"} err="failed to get container status \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": rpc error: code = NotFound desc = could not find container \"388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df\": container with ID starting with 388a13f864bb15fc38c739b64ba5f0e9fa6ce2f8c549b9547891fe0a2a0739df not found: ID does not exist" Jul 06 20:28:03.541857 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.541774 2579 scope.go:117] "RemoveContainer" containerID="99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a" Jul 06 20:28:03.542054 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.542036 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a"} err="failed to get container status \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": rpc error: code = NotFound desc = could not find container \"99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a\": container with ID starting with 99f340bed3f3e35886e5450ff2fd931aa6f8068ca9009fcd3b1495072a689d6a not found: ID does not exist" Jul 06 20:28:03.542124 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.542055 2579 scope.go:117] "RemoveContainer" containerID="3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13" Jul 06 20:28:03.542311 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.542293 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13"} err="failed to get container status \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": rpc error: code = NotFound desc = could not find container \"3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13\": container with ID starting with 3decd07854503e1054916e65d72d5f81df43f18293ba2ab8feafde0adaec4d13 not found: ID does not exist" Jul 06 20:28:03.542365 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.542312 2579 scope.go:117] "RemoveContainer" containerID="59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f" Jul 06 20:28:03.542601 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.542580 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f"} err="failed to get container status \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": rpc error: code = NotFound desc = could not find container \"59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f\": container with ID starting with 59e87d708a446aad2873ef900a38729b3db69d048f60ae9ab6c05c7fc062a75f not found: ID does not exist" Jul 06 20:28:03.544486 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.544473 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:28:03.544529 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.544477 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:28:03.544734 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.544719 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:28:03.544769 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.544754 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:28:03.545075 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.545058 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:28:03.545175 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.545103 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:28:03.545619 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.545582 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:28:03.545619 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.545598 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:28:03.545619 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.545585 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-nlsn6\"" Jul 06 20:28:03.545785 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.545585 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:28:03.545998 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.545962 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:28:03.548216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.548194 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-evek7hpsvjplu\"" Jul 06 20:28:03.548216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.548204 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:28:03.548360 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.548269 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:28:03.551144 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.551123 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:28:03.553231 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.553215 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:28:03.574152 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.573763 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:28:03.646118 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646118 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-config\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646354 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646354 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646354 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646354 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5xk2\" (UniqueName: \"kubernetes.io/projected/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-kube-api-access-c5xk2\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646354 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646354 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646574 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646574 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646399 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646574 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646437 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646574 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646574 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646477 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646574 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646574 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646574 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646558 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646825 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646825 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646825 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.646825 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.646641 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.747401 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.747364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.747525 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.747410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.747525 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.747429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.747525 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.747455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.747684 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.747650 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.747728 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.747702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.747772 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.747741 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748068 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748176 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748176 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748176 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748374 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748175 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748374 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748374 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748278 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-config\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748374 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748374 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748374 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748352 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748374 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5xk2\" (UniqueName: \"kubernetes.io/projected/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-kube-api-access-c5xk2\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748725 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748725 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.748725 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.748467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.749611 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.749583 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.750402 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.750226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.751249 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.750654 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.751249 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.750724 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.751249 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.750797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.751249 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.750900 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.751249 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.750905 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.751249 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.751069 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.751593 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.751295 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.751652 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.751601 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.752093 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.751935 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.752189 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.752099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.752961 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.752934 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.753257 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.753229 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.753634 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.753612 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-config\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.754269 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.754250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.754579 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.754563 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.754923 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.754907 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.759285 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.759262 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5xk2\" (UniqueName: \"kubernetes.io/projected/2a98ba05-6a35-4b62-ac6a-ae69728bb5eb-kube-api-access-c5xk2\") pod \"prometheus-k8s-0\" (UID: \"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.850752 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.850704 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:03.994781 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:03.994748 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:28:03.997597 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:28:03.997564 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a98ba05_6a35_4b62_ac6a_ae69728bb5eb.slice/crio-a8915460e5fe0df1c5eb63937d3564a1d0a7516ca92708b1eee10a531179b51a WatchSource:0}: Error finding container a8915460e5fe0df1c5eb63937d3564a1d0a7516ca92708b1eee10a531179b51a: Status 404 returned error can't find the container with id a8915460e5fe0df1c5eb63937d3564a1d0a7516ca92708b1eee10a531179b51a Jul 06 20:28:04.461894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:04.461856 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="447db947-b579-48b5-a0ae-dc2882b596b7" path="/var/lib/kubelet/pods/447db947-b579-48b5-a0ae-dc2882b596b7/volumes" Jul 06 20:28:04.478106 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:04.478070 2579 generic.go:356] "Generic (PLEG): container finished" podID="2a98ba05-6a35-4b62-ac6a-ae69728bb5eb" containerID="210ce49e8f5991a5bc8fd4cee67ad58bf5a6726ebb8f02c36489168517af191c" exitCode=0 Jul 06 20:28:04.478560 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:04.478160 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb","Type":"ContainerDied","Data":"210ce49e8f5991a5bc8fd4cee67ad58bf5a6726ebb8f02c36489168517af191c"} Jul 06 20:28:04.478560 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:04.478226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb","Type":"ContainerStarted","Data":"a8915460e5fe0df1c5eb63937d3564a1d0a7516ca92708b1eee10a531179b51a"} Jul 06 20:28:05.487410 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.487378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb","Type":"ContainerStarted","Data":"684bc6e4d9cc0b219a84269815682f75414c7fddc65d551519a45b5701edd4b2"} Jul 06 20:28:05.487769 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.487440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb","Type":"ContainerStarted","Data":"50bbb8474a9ed4d03ba90dc90f1e44a9fcf9134c2a0768de3827408dfdaafea1"} Jul 06 20:28:05.487769 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.487465 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb","Type":"ContainerStarted","Data":"95449a975ecc57458cbe406a1c811ed03775e9b66bc7d7f9f6b89ac560e8f0e5"} Jul 06 20:28:05.487769 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.487490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb","Type":"ContainerStarted","Data":"d3bec7c3a45ee3b0e79d927d90ab4cb83ab7d987375daca4194c4138a0b48354"} Jul 06 20:28:05.487769 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.487513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb","Type":"ContainerStarted","Data":"fb8ae86aaa5bd1093253096251bfff1434f0f24c35b193fdd881ff3da89581dd"} Jul 06 20:28:05.487769 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.487535 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a98ba05-6a35-4b62-ac6a-ae69728bb5eb","Type":"ContainerStarted","Data":"a9489b85d73c6b486f14b5ab867033d820b6352c002807fa6761b9ff5a57c103"} Jul 06 20:28:05.516464 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.516409 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.497249438 podStartE2EDuration="2.516391585s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.142147ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:28:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:28:05.514250987 +0000 UTC m=+227.830573602" watchObservedRunningTime="2026-07-06 20:28:05.516391585 +0000 UTC m=+227.832714201" Jul 06 20:28:05.780780 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.780687 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:05.880298 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.880261 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:05.981654 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:05.981619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:07.774163 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:07.774131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:07.881721 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:07.881681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:08.851682 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:08.851652 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:28:10.802514 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:10.802474 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:10.904518 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:10.904474 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:14.431613 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:14.431576 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:14.530689 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:14.530638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:36.364511 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:36.364440 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:36.468424 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:36.468383 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:38.188130 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:38.188073 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:28:38.241309 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:28:38.241277 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:03.851156 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:03.851114 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:29:03.866880 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:03.866850 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:29:04.736444 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:04.736414 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:29:08.398214 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:08.398175 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:09.384142 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:09.384095 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:11.992779 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:11.992719 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:12.061851 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:12.061816 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:13.662398 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:13.662350 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:13.752060 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:13.752030 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:14.368382 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:14.368350 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:14.503777 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:14.503731 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:15.804112 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:15.804077 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:16.049094 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:16.049058 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:18.192489 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:18.192466 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:29:18.199185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:18.199153 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 20:29:18.201554 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:18.201536 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:29:19.219825 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:19.219787 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:19.288713 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:19.288666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:24.464683 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:24.464634 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:25.605490 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:25.605450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:25.706340 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:25.706293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:28.234990 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:28.234949 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:31.710629 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:31.710584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:31.811805 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:31.811766 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:34.382927 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:34.382892 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:35.149276 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:35.149232 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:35.235838 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:35.235799 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:51.538702 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:51.538661 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:51.677431 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:51.677394 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:52.139656 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.139621 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:52.404680 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.404583 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:52.521744 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.521704 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:52.618525 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.618493 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk"] Jul 06 20:29:52.621881 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.621864 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.630106 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.630085 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 20:29:52.630265 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.630246 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 20:29:52.630332 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.630290 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 20:29:52.630396 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.630336 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mc6vc\"" Jul 06 20:29:52.630452 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.630396 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 20:29:52.695568 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.695475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8529670b-eed0-45c1-895f-431202acf617-tmp\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.695568 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.695529 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8757\" (UniqueName: \"kubernetes.io/projected/8529670b-eed0-45c1-895f-431202acf617-kube-api-access-d8757\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.695775 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.695610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8529670b-eed0-45c1-895f-431202acf617-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.695775 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.695672 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8529670b-eed0-45c1-895f-431202acf617-manifests\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.695775 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.695712 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8529670b-eed0-45c1-895f-431202acf617-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.796557 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.796523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8529670b-eed0-45c1-895f-431202acf617-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.796747 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.796567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8529670b-eed0-45c1-895f-431202acf617-manifests\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.796747 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.796593 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8529670b-eed0-45c1-895f-431202acf617-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.796747 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.796637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8529670b-eed0-45c1-895f-431202acf617-tmp\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.796915 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.796832 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8757\" (UniqueName: \"kubernetes.io/projected/8529670b-eed0-45c1-895f-431202acf617-kube-api-access-d8757\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.797033 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.797007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8529670b-eed0-45c1-895f-431202acf617-manifests\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.799264 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.799232 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8529670b-eed0-45c1-895f-431202acf617-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.799399 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.799264 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8529670b-eed0-45c1-895f-431202acf617-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.799399 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.799329 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8529670b-eed0-45c1-895f-431202acf617-tmp\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.830555 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.830524 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk"] Jul 06 20:29:52.839711 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.839680 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8757\" (UniqueName: \"kubernetes.io/projected/8529670b-eed0-45c1-895f-431202acf617-kube-api-access-d8757\") pod \"opendatahub-operator-controller-manager-67f68bd595-sbnrk\" (UID: \"8529670b-eed0-45c1-895f-431202acf617\") " pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:52.930949 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.930902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:52.932777 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:52.932758 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:53.098042 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.098009 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc"] Jul 06 20:29:53.101707 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.101685 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.108451 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.108423 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 20:29:53.108617 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.108471 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 20:29:53.108617 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.108471 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 20:29:53.109319 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.109281 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gw4r6\"" Jul 06 20:29:53.109632 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.109614 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:29:53.117079 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.117056 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 20:29:53.126012 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.125959 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc"] Jul 06 20:29:53.127814 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.127793 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk"] Jul 06 20:29:53.129098 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:29:53.129068 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8529670b_eed0_45c1_895f_431202acf617.slice/crio-0f468243c3367c8d1fe8a7e4ed4396cebfd617015fb2d416efeb385b2071adfd WatchSource:0}: Error finding container 0f468243c3367c8d1fe8a7e4ed4396cebfd617015fb2d416efeb385b2071adfd: Status 404 returned error can't find the container with id 0f468243c3367c8d1fe8a7e4ed4396cebfd617015fb2d416efeb385b2071adfd Jul 06 20:29:53.131394 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.131367 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:29:53.166060 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.166013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:53.201041 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.200974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-metrics-cert\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.201251 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.201112 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njgh7\" (UniqueName: \"kubernetes.io/projected/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-kube-api-access-njgh7\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.201251 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.201186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-cert\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.201251 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.201237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-manager-config\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.298809 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.298769 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:53.301766 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.301747 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njgh7\" (UniqueName: \"kubernetes.io/projected/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-kube-api-access-njgh7\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.301886 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.301781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-cert\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.301886 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.301805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-manager-config\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.301886 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.301848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-metrics-cert\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.302622 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.302599 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-manager-config\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.304345 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.304310 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-metrics-cert\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.304433 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.304377 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-cert\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.319477 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.319449 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njgh7\" (UniqueName: \"kubernetes.io/projected/d5df2f4d-0ed3-4219-bd5a-899cbf59ece7-kube-api-access-njgh7\") pod \"lws-controller-manager-7d444c84c5-fzlvc\" (UID: \"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7\") " pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.389131 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.389091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:53.412159 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.412126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:53.540165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.540129 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:53.561511 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.561489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc"] Jul 06 20:29:53.563532 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:29:53.563508 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5df2f4d_0ed3_4219_bd5a_899cbf59ece7.slice/crio-26eea621cd64161be9cfc057674d18c405891816a3acbd80e7cec106887bdbc9 WatchSource:0}: Error finding container 26eea621cd64161be9cfc057674d18c405891816a3acbd80e7cec106887bdbc9: Status 404 returned error can't find the container with id 26eea621cd64161be9cfc057674d18c405891816a3acbd80e7cec106887bdbc9 Jul 06 20:29:53.717249 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.717201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:53.852397 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.852257 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:29:53.928083 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.928042 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" event={"ID":"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7","Type":"ContainerStarted","Data":"26eea621cd64161be9cfc057674d18c405891816a3acbd80e7cec106887bdbc9"} Jul 06 20:29:53.929961 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:53.929927 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" event={"ID":"8529670b-eed0-45c1-895f-431202acf617","Type":"ContainerStarted","Data":"0f468243c3367c8d1fe8a7e4ed4396cebfd617015fb2d416efeb385b2071adfd"} Jul 06 20:29:57.952010 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:57.951951 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" event={"ID":"8529670b-eed0-45c1-895f-431202acf617","Type":"ContainerStarted","Data":"51ec1e4da33d0f037079ea7204c090938daddbff0ac1e05089f3b7b0c64e9e03"} Jul 06 20:29:57.953446 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:57.953418 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" event={"ID":"d5df2f4d-0ed3-4219-bd5a-899cbf59ece7","Type":"ContainerStarted","Data":"db370247beb038f20bd604751cb0392eb50c514eb5f988c3b0c811b4cb69319c"} Jul 06 20:29:57.953595 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:57.953555 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:29:58.002387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:58.002327 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" podStartSLOduration=1.15589716 podStartE2EDuration="5.002309401s" totalImagesPullingTime="3.846412241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:29:58.000455504 +0000 UTC m=+340.316778147" watchObservedRunningTime="2026-07-06 20:29:58.002309401 +0000 UTC m=+340.318632016" Jul 06 20:29:58.959046 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:58.959005 2579 generic.go:356] "Generic (PLEG): container finished" podID="8529670b-eed0-45c1-895f-431202acf617" containerID="51ec1e4da33d0f037079ea7204c090938daddbff0ac1e05089f3b7b0c64e9e03" exitCode=0 Jul 06 20:29:58.959524 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:58.959076 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" event={"ID":"8529670b-eed0-45c1-895f-431202acf617","Type":"ContainerDied","Data":"51ec1e4da33d0f037079ea7204c090938daddbff0ac1e05089f3b7b0c64e9e03"} Jul 06 20:29:59.964889 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:59.964854 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" event={"ID":"8529670b-eed0-45c1-895f-431202acf617","Type":"ContainerStarted","Data":"7e566331fabd9773726adea28e72de19752145c8bb701d9bf96362520b1732c0"} Jul 06 20:29:59.965310 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:59.964965 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:29:59.990069 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:29:59.990019 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" podStartSLOduration=2.324465726 podStartE2EDuration="7.990001351s" totalImagesPullingTime="4.616877564s" totalInitContainerRuntime="1.048658061s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:29:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:29:59.989524568 +0000 UTC m=+342.305847184" watchObservedRunningTime="2026-07-06 20:29:59.990001351 +0000 UTC m=+342.306323967" Jul 06 20:30:08.961438 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:08.961404 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d444c84c5-fzlvc" Jul 06 20:30:10.972295 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:10.972261 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67f68bd595-sbnrk" Jul 06 20:30:12.818946 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:12.818898 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:12.969847 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:12.969802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:18.643769 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.643727 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:18.663278 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.663241 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7"] Jul 06 20:30:18.670198 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.670157 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.672705 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.672676 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 20:30:18.672851 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.672690 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 20:30:18.673087 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.673072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-52wf4\"" Jul 06 20:30:18.681092 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.681064 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7"] Jul 06 20:30:18.799257 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.799214 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:18.849177 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.849147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16cfcb81-eb19-4a06-8f39-072ba4e177da-tls-certs\") pod \"kube-auth-proxy-cd668b4d4-7zkp7\" (UID: \"16cfcb81-eb19-4a06-8f39-072ba4e177da\") " pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.849358 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.849191 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16cfcb81-eb19-4a06-8f39-072ba4e177da-tmp\") pod \"kube-auth-proxy-cd668b4d4-7zkp7\" (UID: \"16cfcb81-eb19-4a06-8f39-072ba4e177da\") " pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.849358 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.849226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktgwr\" (UniqueName: \"kubernetes.io/projected/16cfcb81-eb19-4a06-8f39-072ba4e177da-kube-api-access-ktgwr\") pod \"kube-auth-proxy-cd668b4d4-7zkp7\" (UID: \"16cfcb81-eb19-4a06-8f39-072ba4e177da\") " pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.889967 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.889936 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:18.949871 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.949781 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktgwr\" (UniqueName: \"kubernetes.io/projected/16cfcb81-eb19-4a06-8f39-072ba4e177da-kube-api-access-ktgwr\") pod \"kube-auth-proxy-cd668b4d4-7zkp7\" (UID: \"16cfcb81-eb19-4a06-8f39-072ba4e177da\") " pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.949871 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.949862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16cfcb81-eb19-4a06-8f39-072ba4e177da-tls-certs\") pod \"kube-auth-proxy-cd668b4d4-7zkp7\" (UID: \"16cfcb81-eb19-4a06-8f39-072ba4e177da\") " pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.950080 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.949896 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16cfcb81-eb19-4a06-8f39-072ba4e177da-tmp\") pod \"kube-auth-proxy-cd668b4d4-7zkp7\" (UID: \"16cfcb81-eb19-4a06-8f39-072ba4e177da\") " pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.952172 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.952147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/16cfcb81-eb19-4a06-8f39-072ba4e177da-tmp\") pod \"kube-auth-proxy-cd668b4d4-7zkp7\" (UID: \"16cfcb81-eb19-4a06-8f39-072ba4e177da\") " pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.952354 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.952337 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/16cfcb81-eb19-4a06-8f39-072ba4e177da-tls-certs\") pod \"kube-auth-proxy-cd668b4d4-7zkp7\" (UID: \"16cfcb81-eb19-4a06-8f39-072ba4e177da\") " pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.961411 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.961387 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktgwr\" (UniqueName: \"kubernetes.io/projected/16cfcb81-eb19-4a06-8f39-072ba4e177da-kube-api-access-ktgwr\") pod \"kube-auth-proxy-cd668b4d4-7zkp7\" (UID: \"16cfcb81-eb19-4a06-8f39-072ba4e177da\") " pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.980121 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.980095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" Jul 06 20:30:18.991223 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:18.991191 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:19.093731 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:19.093685 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:19.124030 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:19.124007 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7"] Jul 06 20:30:19.125901 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:30:19.125879 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16cfcb81_eb19_4a06_8f39_072ba4e177da.slice/crio-6d6fc135c144790641fe189c6f9503e2d6917893122f3cf4780b1c5c6a45d019 WatchSource:0}: Error finding container 6d6fc135c144790641fe189c6f9503e2d6917893122f3cf4780b1c5c6a45d019: Status 404 returned error can't find the container with id 6d6fc135c144790641fe189c6f9503e2d6917893122f3cf4780b1c5c6a45d019 Jul 06 20:30:19.305141 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:19.305109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:19.532348 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:19.532295 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:20.057086 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:20.057047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" event={"ID":"16cfcb81-eb19-4a06-8f39-072ba4e177da","Type":"ContainerStarted","Data":"6d6fc135c144790641fe189c6f9503e2d6917893122f3cf4780b1c5c6a45d019"} Jul 06 20:30:20.292973 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:20.292932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:21.837245 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:21.837207 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:23.074232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:23.074192 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" event={"ID":"16cfcb81-eb19-4a06-8f39-072ba4e177da","Type":"ContainerStarted","Data":"053cd23b519d273f06c4b7deda46b98839d251c00dc8bd9bbe422b7b21a5ab85"} Jul 06 20:30:23.094909 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:23.094858 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-cd668b4d4-7zkp7" podStartSLOduration=1.877004935 podStartE2EDuration="5.09484072s" totalImagesPullingTime="3.217835785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:23.093612463 +0000 UTC m=+365.409935093" watchObservedRunningTime="2026-07-06 20:30:23.09484072 +0000 UTC m=+365.411163336" Jul 06 20:30:25.675216 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:25.675180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:25.770971 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:25.770924 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:26.857762 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:26.857707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:27.333671 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:27.333636 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:27.458676 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:27.458645 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:31.022305 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:31.022273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:31.238428 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:31.238380 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:31.404920 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:31.404881 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:31.519681 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:31.519642 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:31.637092 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:31.637050 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:31.809705 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:31.809665 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:53.187805 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:53.187766 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:30:53.287689 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:30:53.287653 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:12.101640 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:12.101599 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:14.242105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:14.242072 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:14.306621 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:14.306584 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:14.445272 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:14.445223 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:15.182883 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:15.182838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:15.349896 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:15.349855 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:15.421322 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:15.421282 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:35.774310 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:35.774273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:43.442064 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:43.441965 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:46.910472 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:46.910432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:48.441810 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:48.441771 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:48.842391 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:48.842350 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:49.920807 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:49.920767 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:50.055858 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:50.055822 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:51.505641 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:51.505606 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:51.627758 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:51.627722 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:53.697279 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:53.697234 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:55.080767 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.080728 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h"] Jul 06 20:31:55.084277 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.084253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:31:55.087222 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.087200 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-sxw46\"" Jul 06 20:31:55.087781 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.087768 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 20:31:55.088227 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.088209 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 20:31:55.098577 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.098547 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h"] Jul 06 20:31:55.106120 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.106091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4vg2\" (UniqueName: \"kubernetes.io/projected/070ffed3-4f6d-44b0-ade5-61486c0a4329-kube-api-access-k4vg2\") pod \"limitador-operator-controller-manager-859d7b78bd-wxq8h\" (UID: \"070ffed3-4f6d-44b0-ade5-61486c0a4329\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:31:55.206911 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.206866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4vg2\" (UniqueName: \"kubernetes.io/projected/070ffed3-4f6d-44b0-ade5-61486c0a4329-kube-api-access-k4vg2\") pod \"limitador-operator-controller-manager-859d7b78bd-wxq8h\" (UID: \"070ffed3-4f6d-44b0-ade5-61486c0a4329\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:31:55.223057 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.223021 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4vg2\" (UniqueName: \"kubernetes.io/projected/070ffed3-4f6d-44b0-ade5-61486c0a4329-kube-api-access-k4vg2\") pod \"limitador-operator-controller-manager-859d7b78bd-wxq8h\" (UID: \"070ffed3-4f6d-44b0-ade5-61486c0a4329\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:31:55.394653 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.394556 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:31:55.540280 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.540249 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h"] Jul 06 20:31:55.543023 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:31:55.542993 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070ffed3_4f6d_44b0_ade5_61486c0a4329.slice/crio-6d1b17f1ddb628ee9710c7bc9f195b2873a45253a3dce39c19eefe515a39acd0 WatchSource:0}: Error finding container 6d1b17f1ddb628ee9710c7bc9f195b2873a45253a3dce39c19eefe515a39acd0: Status 404 returned error can't find the container with id 6d1b17f1ddb628ee9710c7bc9f195b2873a45253a3dce39c19eefe515a39acd0 Jul 06 20:31:55.560652 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:55.560615 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:56.504473 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:56.504439 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" event={"ID":"070ffed3-4f6d-44b0-ade5-61486c0a4329","Type":"ContainerStarted","Data":"6d1b17f1ddb628ee9710c7bc9f195b2873a45253a3dce39c19eefe515a39acd0"} Jul 06 20:31:57.560963 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:57.560924 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:57.659628 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:57.659583 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:58.515494 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:58.515461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" event={"ID":"070ffed3-4f6d-44b0-ade5-61486c0a4329","Type":"ContainerStarted","Data":"fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714"} Jul 06 20:31:58.515693 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:58.515592 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:31:58.533340 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:58.533283 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" podStartSLOduration=1.353285459 podStartE2EDuration="3.53326872s" totalImagesPullingTime="2.179983261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:31:58.531588172 +0000 UTC m=+460.847910786" watchObservedRunningTime="2026-07-06 20:31:58.53326872 +0000 UTC m=+460.849591432" Jul 06 20:31:58.852847 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:58.852808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:31:58.992744 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:31:58.992706 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:07.356135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:07.356093 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:07.494729 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:07.494694 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:09.432737 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.432701 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:09.521788 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.521760 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:32:09.530417 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.530385 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:09.726597 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.726513 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h"] Jul 06 20:32:09.727373 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.726792 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" podUID="070ffed3-4f6d-44b0-ade5-61486c0a4329" containerName="manager" containerID="cri-o://fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714" gracePeriod=2 Jul 06 20:32:09.727373 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.726809 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:09.739232 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.739199 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h"] Jul 06 20:32:09.745602 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:32:09.745563 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"070ffed3-4f6d-44b0-ade5-61486c0a4329\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-wxq8h\": pods \"limitador-operator-controller-manager-859d7b78bd-wxq8h\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:32:09.753557 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.753525 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586"] Jul 06 20:32:09.753944 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.753926 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="070ffed3-4f6d-44b0-ade5-61486c0a4329" containerName="manager" Jul 06 20:32:09.754059 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.753945 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="070ffed3-4f6d-44b0-ade5-61486c0a4329" containerName="manager" Jul 06 20:32:09.754122 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.754076 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="070ffed3-4f6d-44b0-ade5-61486c0a4329" containerName="manager" Jul 06 20:32:09.758325 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.758300 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" Jul 06 20:32:09.760941 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:32:09.760906 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wxq8h\" is forbidden: User \"system:node:ip-10-0-136-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-213.ec2.internal' and this object" podUID="070ffed3-4f6d-44b0-ade5-61486c0a4329" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:32:09.780169 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.774280 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586"] Jul 06 20:32:09.819433 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.819398 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:09.842455 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.842384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r6qk\" (UniqueName: \"kubernetes.io/projected/a03b7e7d-5a70-49b9-87b4-5160939ac076-kube-api-access-2r6qk\") pod \"limitador-operator-controller-manager-859d7b78bd-pq586\" (UID: \"a03b7e7d-5a70-49b9-87b4-5160939ac076\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" Jul 06 20:32:09.943636 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.943592 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r6qk\" (UniqueName: \"kubernetes.io/projected/a03b7e7d-5a70-49b9-87b4-5160939ac076-kube-api-access-2r6qk\") pod \"limitador-operator-controller-manager-859d7b78bd-pq586\" (UID: \"a03b7e7d-5a70-49b9-87b4-5160939ac076\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" Jul 06 20:32:09.970680 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.970652 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r6qk\" (UniqueName: \"kubernetes.io/projected/a03b7e7d-5a70-49b9-87b4-5160939ac076-kube-api-access-2r6qk\") pod \"limitador-operator-controller-manager-859d7b78bd-pq586\" (UID: \"a03b7e7d-5a70-49b9-87b4-5160939ac076\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" Jul 06 20:32:09.972416 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:09.972392 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:32:09.974664 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:32:09.974635 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wxq8h\" is forbidden: User \"system:node:ip-10-0-136-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-213.ec2.internal' and this object" podUID="070ffed3-4f6d-44b0-ade5-61486c0a4329" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:32:10.044791 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.044763 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4vg2\" (UniqueName: \"kubernetes.io/projected/070ffed3-4f6d-44b0-ade5-61486c0a4329-kube-api-access-k4vg2\") pod \"070ffed3-4f6d-44b0-ade5-61486c0a4329\" (UID: \"070ffed3-4f6d-44b0-ade5-61486c0a4329\") " Jul 06 20:32:10.046964 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.046934 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/070ffed3-4f6d-44b0-ade5-61486c0a4329-kube-api-access-k4vg2" (OuterVolumeSpecName: "kube-api-access-k4vg2") pod "070ffed3-4f6d-44b0-ade5-61486c0a4329" (UID: "070ffed3-4f6d-44b0-ade5-61486c0a4329"). InnerVolumeSpecName "kube-api-access-k4vg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:32:10.099176 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.099134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" Jul 06 20:32:10.145927 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.145890 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4vg2\" (UniqueName: \"kubernetes.io/projected/070ffed3-4f6d-44b0-ade5-61486c0a4329-kube-api-access-k4vg2\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:32:10.239625 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.239528 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586"] Jul 06 20:32:10.242402 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:32:10.242370 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03b7e7d_5a70_49b9_87b4_5160939ac076.slice/crio-3cc1aed4393a61ded43aa405f301de6e8296a8a41682596b9766e74c12760001 WatchSource:0}: Error finding container 3cc1aed4393a61ded43aa405f301de6e8296a8a41682596b9766e74c12760001: Status 404 returned error can't find the container with id 3cc1aed4393a61ded43aa405f301de6e8296a8a41682596b9766e74c12760001 Jul 06 20:32:10.462192 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.462156 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="070ffed3-4f6d-44b0-ade5-61486c0a4329" path="/var/lib/kubelet/pods/070ffed3-4f6d-44b0-ade5-61486c0a4329/volumes" Jul 06 20:32:10.571894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.571803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" event={"ID":"a03b7e7d-5a70-49b9-87b4-5160939ac076","Type":"ContainerStarted","Data":"db855bed23a2718e340b11d5b068318eac1ad095a96f024766bdef391344259d"} Jul 06 20:32:10.571894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.571858 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" event={"ID":"a03b7e7d-5a70-49b9-87b4-5160939ac076","Type":"ContainerStarted","Data":"3cc1aed4393a61ded43aa405f301de6e8296a8a41682596b9766e74c12760001"} Jul 06 20:32:10.571894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.571881 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" Jul 06 20:32:10.573277 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.573247 2579 generic.go:356] "Generic (PLEG): container finished" podID="070ffed3-4f6d-44b0-ade5-61486c0a4329" containerID="fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714" exitCode=0 Jul 06 20:32:10.573407 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.573280 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxq8h" Jul 06 20:32:10.573407 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.573300 2579 scope.go:117] "RemoveContainer" containerID="fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714" Jul 06 20:32:10.581591 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.581567 2579 scope.go:117] "RemoveContainer" containerID="fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714" Jul 06 20:32:10.581892 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:32:10.581863 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714\": container with ID starting with fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714 not found: ID does not exist" containerID="fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714" Jul 06 20:32:10.581990 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.581899 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714"} err="failed to get container status \"fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714\": rpc error: code = NotFound desc = could not find container \"fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714\": container with ID starting with fa5e5a9d888b0cc7fa137313cc4a512859f2f6d126aaf57add777e285ecae714 not found: ID does not exist" Jul 06 20:32:10.602084 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:10.602026 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" podStartSLOduration=1.602009118 podStartE2EDuration="1.602009118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:32:10.600804123 +0000 UTC m=+472.917126733" watchObservedRunningTime="2026-07-06 20:32:10.602009118 +0000 UTC m=+472.918331729" Jul 06 20:32:14.529453 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:14.529400 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:14.630577 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:14.630512 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:18.316940 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:18.316902 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:18.414961 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:18.414922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:21.582442 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:21.582404 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pq586" Jul 06 20:32:27.118464 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:27.118405 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:27.216250 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:27.216182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:29.589241 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:29.589203 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:29.844418 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:29.844313 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:30.309166 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:30.309113 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:30.409639 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:30.409609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:30.483518 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:30.483478 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:34.261424 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:34.261388 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:34.379337 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:34.379297 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:51.578999 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:51.578726 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:51.671112 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:51.671080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:53.409489 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:53.409445 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:53.529296 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:53.529235 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:53.623342 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:53.623307 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:53.945639 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:53.945603 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:32:53.949139 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:53.949120 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:32:53.953483 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:53.953459 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 20:32:53.953616 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:53.953460 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c4plq\"" Jul 06 20:32:53.965178 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:53.965151 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:32:53.994304 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:53.994265 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:32:54.037864 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.037833 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sjbb\" (UniqueName: \"kubernetes.io/projected/5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01-kube-api-access-8sjbb\") pod \"limitador-limitador-54d6d988d5-l52hq\" (UID: \"5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:32:54.038040 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.037932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01-config-file\") pod \"limitador-limitador-54d6d988d5-l52hq\" (UID: \"5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:32:54.138462 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.138424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sjbb\" (UniqueName: \"kubernetes.io/projected/5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01-kube-api-access-8sjbb\") pod \"limitador-limitador-54d6d988d5-l52hq\" (UID: \"5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:32:54.138677 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.138507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01-config-file\") pod \"limitador-limitador-54d6d988d5-l52hq\" (UID: \"5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:32:54.139185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.139161 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01-config-file\") pod \"limitador-limitador-54d6d988d5-l52hq\" (UID: \"5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:32:54.147005 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.146956 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sjbb\" (UniqueName: \"kubernetes.io/projected/5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01-kube-api-access-8sjbb\") pod \"limitador-limitador-54d6d988d5-l52hq\" (UID: \"5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:32:54.259836 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.259748 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:32:54.276630 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.276593 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:54.348224 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.348192 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:32:54.399806 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.399780 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:32:54.401853 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:32:54.401827 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2ecc4d_8b73_41d7_bca9_2fa7fb6b2f01.slice/crio-74c065006b8ad8bdaf5d8453ac077bebd31e9643f17232bd33f617c0c1736383 WatchSource:0}: Error finding container 74c065006b8ad8bdaf5d8453ac077bebd31e9643f17232bd33f617c0c1736383: Status 404 returned error can't find the container with id 74c065006b8ad8bdaf5d8453ac077bebd31e9643f17232bd33f617c0c1736383 Jul 06 20:32:54.454529 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.454490 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-g28wk"] Jul 06 20:32:54.462170 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.462134 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g28wk" Jul 06 20:32:54.465585 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.465563 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4bdzw\"" Jul 06 20:32:54.468908 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.468876 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g28wk"] Jul 06 20:32:54.542856 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.542819 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckqrp\" (UniqueName: \"kubernetes.io/projected/ab1b0afb-25ee-434d-a663-bad508e02739-kube-api-access-ckqrp\") pod \"authorino-75d556bd77-g28wk\" (UID: \"ab1b0afb-25ee-434d-a663-bad508e02739\") " pod="kuadrant-system/authorino-75d556bd77-g28wk" Jul 06 20:32:54.644105 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.644074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckqrp\" (UniqueName: \"kubernetes.io/projected/ab1b0afb-25ee-434d-a663-bad508e02739-kube-api-access-ckqrp\") pod \"authorino-75d556bd77-g28wk\" (UID: \"ab1b0afb-25ee-434d-a663-bad508e02739\") " pod="kuadrant-system/authorino-75d556bd77-g28wk" Jul 06 20:32:54.654646 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.654614 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckqrp\" (UniqueName: \"kubernetes.io/projected/ab1b0afb-25ee-434d-a663-bad508e02739-kube-api-access-ckqrp\") pod \"authorino-75d556bd77-g28wk\" (UID: \"ab1b0afb-25ee-434d-a663-bad508e02739\") " pod="kuadrant-system/authorino-75d556bd77-g28wk" Jul 06 20:32:54.780767 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.780732 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" event={"ID":"5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01","Type":"ContainerStarted","Data":"74c065006b8ad8bdaf5d8453ac077bebd31e9643f17232bd33f617c0c1736383"} Jul 06 20:32:54.786843 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.786817 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g28wk" Jul 06 20:32:54.922427 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:54.922395 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g28wk"] Jul 06 20:32:54.925619 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:32:54.925593 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab1b0afb_25ee_434d_a663_bad508e02739.slice/crio-a998ce3e34587dad497c836a286c7fee1166d69d7dbfcd80a560dd352d55a936 WatchSource:0}: Error finding container a998ce3e34587dad497c836a286c7fee1166d69d7dbfcd80a560dd352d55a936: Status 404 returned error can't find the container with id a998ce3e34587dad497c836a286c7fee1166d69d7dbfcd80a560dd352d55a936 Jul 06 20:32:54.946404 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:32:54.946353 2579 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/kuadrant/limitador:v2.3.0" Jul 06 20:32:54.946576 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:32:54.946483 2579 kuberuntime_manager.go:1459] "Unhandled Error" err="container limitador start failed in pod limitador-limitador-54d6d988d5-l52hq_kuadrant-system(5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 06 20:32:54.946576 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:32:54.946524 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"limitador\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" podUID="5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01" Jul 06 20:32:55.791927 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:55.791699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g28wk" event={"ID":"ab1b0afb-25ee-434d-a663-bad508e02739","Type":"ContainerStarted","Data":"a998ce3e34587dad497c836a286c7fee1166d69d7dbfcd80a560dd352d55a936"} Jul 06 20:32:55.793497 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:32:55.793237 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"limitador\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/kuadrant/limitador:v2.3.0\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" podUID="5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01" Jul 06 20:32:58.807049 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:58.807015 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g28wk" event={"ID":"ab1b0afb-25ee-434d-a663-bad508e02739","Type":"ContainerStarted","Data":"bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0"} Jul 06 20:32:58.821898 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:32:58.821846 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-g28wk" podStartSLOduration=1.65002075 podStartE2EDuration="4.821830259s" totalImagesPullingTime="3.171809509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:32:58.821133589 +0000 UTC m=+521.137456204" watchObservedRunningTime="2026-07-06 20:32:58.821830259 +0000 UTC m=+521.138152942" Jul 06 20:33:10.864383 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:10.864348 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" event={"ID":"5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01","Type":"ContainerStarted","Data":"d27aef80bd54da6d99c2508e894542d9fd7cd148e3f9c76f0024f77a8d7e9a1c"} Jul 06 20:33:10.864792 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:10.864565 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:33:10.887395 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:10.887340 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" podStartSLOduration=2.102327916 podStartE2EDuration="17.887318871s" totalImagesPullingTime="15.784990955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-06 20:33:10.886391974 +0000 UTC m=+533.202714590" watchObservedRunningTime="2026-07-06 20:33:10.887318871 +0000 UTC m=+533.203641492" Jul 06 20:33:21.871495 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:21.871465 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-l52hq" Jul 06 20:33:25.092712 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:25.092672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:33:37.131841 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:37.131802 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:33:37.412802 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:37.412718 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:33:38.580155 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.580118 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g28wk"] Jul 06 20:33:38.580578 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.580291 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-g28wk" podUID="ab1b0afb-25ee-434d-a663-bad508e02739" containerName="authorino" containerID="cri-o://bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0" gracePeriod=30 Jul 06 20:33:38.821634 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.821604 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g28wk" Jul 06 20:33:38.919405 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.919311 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckqrp\" (UniqueName: \"kubernetes.io/projected/ab1b0afb-25ee-434d-a663-bad508e02739-kube-api-access-ckqrp\") pod \"ab1b0afb-25ee-434d-a663-bad508e02739\" (UID: \"ab1b0afb-25ee-434d-a663-bad508e02739\") " Jul 06 20:33:38.921330 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.921300 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1b0afb-25ee-434d-a663-bad508e02739-kube-api-access-ckqrp" (OuterVolumeSpecName: "kube-api-access-ckqrp") pod "ab1b0afb-25ee-434d-a663-bad508e02739" (UID: "ab1b0afb-25ee-434d-a663-bad508e02739"). InnerVolumeSpecName "kube-api-access-ckqrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:33:38.997123 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.997085 2579 generic.go:356] "Generic (PLEG): container finished" podID="ab1b0afb-25ee-434d-a663-bad508e02739" containerID="bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0" exitCode=0 Jul 06 20:33:38.997316 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.997135 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-g28wk" Jul 06 20:33:38.997316 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.997148 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g28wk" event={"ID":"ab1b0afb-25ee-434d-a663-bad508e02739","Type":"ContainerDied","Data":"bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0"} Jul 06 20:33:38.997316 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.997183 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-g28wk" event={"ID":"ab1b0afb-25ee-434d-a663-bad508e02739","Type":"ContainerDied","Data":"a998ce3e34587dad497c836a286c7fee1166d69d7dbfcd80a560dd352d55a936"} Jul 06 20:33:38.997316 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:38.997201 2579 scope.go:117] "RemoveContainer" containerID="bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0" Jul 06 20:33:39.005522 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:39.005501 2579 scope.go:117] "RemoveContainer" containerID="bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0" Jul 06 20:33:39.005783 ip-10-0-136-213 kubenswrapper[2579]: E0706 20:33:39.005766 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0\": container with ID starting with bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0 not found: ID does not exist" containerID="bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0" Jul 06 20:33:39.005829 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:39.005791 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0"} err="failed to get container status \"bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0\": rpc error: code = NotFound desc = could not find container \"bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0\": container with ID starting with bbed1e78b4a5fd21d07c94c36af0e191a5b2f42fc611f3083531ba42584060d0 not found: ID does not exist" Jul 06 20:33:39.020310 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:39.020276 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckqrp\" (UniqueName: \"kubernetes.io/projected/ab1b0afb-25ee-434d-a663-bad508e02739-kube-api-access-ckqrp\") on node \"ip-10-0-136-213.ec2.internal\" DevicePath \"\"" Jul 06 20:33:39.020918 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:39.020893 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g28wk"] Jul 06 20:33:39.027836 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:39.027802 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-g28wk"] Jul 06 20:33:40.462241 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:40.462208 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab1b0afb-25ee-434d-a663-bad508e02739" path="/var/lib/kubelet/pods/ab1b0afb-25ee-434d-a663-bad508e02739/volumes" Jul 06 20:33:43.047531 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:43.047491 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:33:43.144600 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:43.144564 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:33:43.242827 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:43.242786 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:33:43.343243 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:43.343153 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:33:46.036618 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:46.036583 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:33:46.147951 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:46.147918 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:33:51.177969 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:33:51.177925 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:34:17.220402 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:17.220355 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:34:17.600639 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:17.600598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:34:18.064859 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:18.064824 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:34:18.159126 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:18.159092 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:34:18.195329 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:18.195291 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:34:18.224293 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:18.224260 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:34:18.231329 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:18.231298 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:34:28.831736 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:28.831700 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:34:28.932783 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:28.932738 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:34:40.688176 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:40.688095 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:34:41.075085 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:41.075044 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:34:58.367661 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:58.367621 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:34:59.064846 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:34:59.064812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:35:03.595513 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:03.595457 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:03.671189 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:03.671142 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:06.471277 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:06.471239 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:07.463732 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:07.463697 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:35:19.593133 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:19.593088 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:24.057000 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:24.056937 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:25.423378 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:25.423343 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:30.958248 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.958217 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn"] Jul 06 20:35:30.958772 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.958601 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1b0afb-25ee-434d-a663-bad508e02739" containerName="authorino" Jul 06 20:35:30.958772 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.958613 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1b0afb-25ee-434d-a663-bad508e02739" containerName="authorino" Jul 06 20:35:30.958772 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.958665 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1b0afb-25ee-434d-a663-bad508e02739" containerName="authorino" Jul 06 20:35:30.960712 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.960693 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:30.963070 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.963046 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 20:35:30.963220 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.963104 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-25gn5\"" Jul 06 20:35:30.963716 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.963695 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 20:35:30.963827 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.963762 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 20:35:30.972571 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.972548 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn"] Jul 06 20:35:30.995606 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:30.995567 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:31.017582 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.017548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc2nm\" (UniqueName: \"kubernetes.io/projected/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-kube-api-access-bc2nm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.017751 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.017595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.017751 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.017650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.017751 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.017689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.017751 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.017708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.017894 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.017811 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.119077 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.119042 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc2nm\" (UniqueName: \"kubernetes.io/projected/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-kube-api-access-bc2nm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.119271 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.119087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.119271 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.119107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.119271 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.119227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.119271 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.119267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.119507 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.119345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.119597 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.119576 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.119663 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.119617 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.119721 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.119698 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.121408 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.121389 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.121661 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.121641 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.127291 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.127269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc2nm\" (UniqueName: \"kubernetes.io/projected/50e4e67f-0b2c-40f3-99b6-56f1f574bcc0-kube-api-access-bc2nm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn\" (UID: \"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.272675 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.272585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:31.409167 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.409139 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn"] Jul 06 20:35:31.411635 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:35:31.411597 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e4e67f_0b2c_40f3_99b6_56f1f574bcc0.slice/crio-2440a3b3821df941e037ff1d9125904215d197669c99c1dfd74c5c4ce10e1793 WatchSource:0}: Error finding container 2440a3b3821df941e037ff1d9125904215d197669c99c1dfd74c5c4ce10e1793: Status 404 returned error can't find the container with id 2440a3b3821df941e037ff1d9125904215d197669c99c1dfd74c5c4ce10e1793 Jul 06 20:35:31.412991 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.412957 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:35:31.519367 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:31.519336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" event={"ID":"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0","Type":"ContainerStarted","Data":"2440a3b3821df941e037ff1d9125904215d197669c99c1dfd74c5c4ce10e1793"} Jul 06 20:35:32.367673 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:32.367633 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:35:32.525489 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:32.525452 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" event={"ID":"50e4e67f-0b2c-40f3-99b6-56f1f574bcc0","Type":"ContainerStarted","Data":"5dad39211e6af6dc11a83df70a55bc0c9f06d46dcfa1282604ac37339d6853d8"} Jul 06 20:35:41.273433 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:41.273381 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:41.274073 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:41.273465 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:41.286074 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:41.286041 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:41.308780 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:41.308730 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" podStartSLOduration=10.287940705 podStartE2EDuration="11.308714993s" totalImagesPullingTime="1.020774288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:32.541519692 +0000 UTC m=+674.857842306" watchObservedRunningTime="2026-07-06 20:35:41.308714993 +0000 UTC m=+683.625037608" Jul 06 20:35:41.585116 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:41.585083 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn" Jul 06 20:35:42.408203 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:42.408167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:43.569557 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:43.569519 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:35:46.060703 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.060665 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4"] Jul 06 20:35:46.062990 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.062961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.065354 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.065323 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 06 20:35:46.076612 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.076586 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4"] Jul 06 20:35:46.151774 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.151729 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:35:46.157992 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.157954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.158090 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.158039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.158090 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.158069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.158165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.158090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhgxs\" (UniqueName: \"kubernetes.io/projected/8068f949-c3db-46a9-9389-68a78aa663ae-kube-api-access-jhgxs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.158165 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.158122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.158230 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.158208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8068f949-c3db-46a9-9389-68a78aa663ae-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.259372 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.259333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.259549 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.259393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.259549 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.259424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.259549 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.259451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhgxs\" (UniqueName: \"kubernetes.io/projected/8068f949-c3db-46a9-9389-68a78aa663ae-kube-api-access-jhgxs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.259549 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.259499 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.259749 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.259559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8068f949-c3db-46a9-9389-68a78aa663ae-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.259907 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.259884 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.259957 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.259916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.259957 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.259887 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.261795 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.261775 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8068f949-c3db-46a9-9389-68a78aa663ae-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.261947 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.261929 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8068f949-c3db-46a9-9389-68a78aa663ae-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.271384 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.271353 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhgxs\" (UniqueName: \"kubernetes.io/projected/8068f949-c3db-46a9-9389-68a78aa663ae-kube-api-access-jhgxs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4\" (UID: \"8068f949-c3db-46a9-9389-68a78aa663ae\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.380060 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.379946 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:46.531838 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.531805 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4"] Jul 06 20:35:46.535146 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:35:46.535116 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8068f949_c3db_46a9_9389_68a78aa663ae.slice/crio-5a758c1c45eaee25588c718a4759e3c950e1d07d676f95c936ac40ced21b062f WatchSource:0}: Error finding container 5a758c1c45eaee25588c718a4759e3c950e1d07d676f95c936ac40ced21b062f: Status 404 returned error can't find the container with id 5a758c1c45eaee25588c718a4759e3c950e1d07d676f95c936ac40ced21b062f Jul 06 20:35:46.596710 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:46.596677 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" event={"ID":"8068f949-c3db-46a9-9389-68a78aa663ae","Type":"ContainerStarted","Data":"5a758c1c45eaee25588c718a4759e3c950e1d07d676f95c936ac40ced21b062f"} Jul 06 20:35:47.603163 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:47.603127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" event={"ID":"8068f949-c3db-46a9-9389-68a78aa663ae","Type":"ContainerStarted","Data":"1ec5cbd041d8ff7dbbb2fcff63355d5495960800764ae2df177c0aeea1f8100d"} Jul 06 20:35:47.623249 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:47.623198 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" podStartSLOduration=1.438528477 podStartE2EDuration="1.623182292s" totalImagesPullingTime="184.653815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:35:47.621667165 +0000 UTC m=+689.937989781" watchObservedRunningTime="2026-07-06 20:35:47.623182292 +0000 UTC m=+689.939504886" Jul 06 20:35:54.155206 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:54.155155 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:35:56.380332 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:56.380289 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:56.380332 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:56.380339 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:56.392853 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:56.392820 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:35:56.655414 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:35:56.655328 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4" Jul 06 20:36:44.551245 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.551209 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-554b5bfdf7-s6pvc"] Jul 06 20:36:44.554470 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.554446 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" Jul 06 20:36:44.558412 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.558383 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-4bdzw\"" Jul 06 20:36:44.559185 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.559169 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 20:36:44.573926 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.573891 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-554b5bfdf7-s6pvc"] Jul 06 20:36:44.694459 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.694422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80915357-4bfc-4c15-b4b8-6ff71b50b16b-tls-cert\") pod \"authorino-554b5bfdf7-s6pvc\" (UID: \"80915357-4bfc-4c15-b4b8-6ff71b50b16b\") " pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" Jul 06 20:36:44.694640 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.694526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqb7f\" (UniqueName: \"kubernetes.io/projected/80915357-4bfc-4c15-b4b8-6ff71b50b16b-kube-api-access-xqb7f\") pod \"authorino-554b5bfdf7-s6pvc\" (UID: \"80915357-4bfc-4c15-b4b8-6ff71b50b16b\") " pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" Jul 06 20:36:44.795378 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.795334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80915357-4bfc-4c15-b4b8-6ff71b50b16b-tls-cert\") pod \"authorino-554b5bfdf7-s6pvc\" (UID: \"80915357-4bfc-4c15-b4b8-6ff71b50b16b\") " pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" Jul 06 20:36:44.795557 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.795433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqb7f\" (UniqueName: \"kubernetes.io/projected/80915357-4bfc-4c15-b4b8-6ff71b50b16b-kube-api-access-xqb7f\") pod \"authorino-554b5bfdf7-s6pvc\" (UID: \"80915357-4bfc-4c15-b4b8-6ff71b50b16b\") " pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" Jul 06 20:36:44.797767 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.797741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/80915357-4bfc-4c15-b4b8-6ff71b50b16b-tls-cert\") pod \"authorino-554b5bfdf7-s6pvc\" (UID: \"80915357-4bfc-4c15-b4b8-6ff71b50b16b\") " pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" Jul 06 20:36:44.812293 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.812227 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqb7f\" (UniqueName: \"kubernetes.io/projected/80915357-4bfc-4c15-b4b8-6ff71b50b16b-kube-api-access-xqb7f\") pod \"authorino-554b5bfdf7-s6pvc\" (UID: \"80915357-4bfc-4c15-b4b8-6ff71b50b16b\") " pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" Jul 06 20:36:44.863674 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.863639 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" Jul 06 20:36:44.895739 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:44.895704 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:45.002869 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:45.002839 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:45.007437 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:45.007416 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-554b5bfdf7-s6pvc"] Jul 06 20:36:45.010094 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:36:45.010068 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80915357_4bfc_4c15_b4b8_6ff71b50b16b.slice/crio-28c10c714bc1ce313cdb2cba1ceb8739dc8c80219fcfbee6890e61afeca9a99e WatchSource:0}: Error finding container 28c10c714bc1ce313cdb2cba1ceb8739dc8c80219fcfbee6890e61afeca9a99e: Status 404 returned error can't find the container with id 28c10c714bc1ce313cdb2cba1ceb8739dc8c80219fcfbee6890e61afeca9a99e Jul 06 20:36:45.876297 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:45.876258 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" event={"ID":"80915357-4bfc-4c15-b4b8-6ff71b50b16b","Type":"ContainerStarted","Data":"f01980d1f16ffd8bc4656e1d5a556dfd8b30969c7f539e46c4774b285572878e"} Jul 06 20:36:45.876297 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:45.876304 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" event={"ID":"80915357-4bfc-4c15-b4b8-6ff71b50b16b","Type":"ContainerStarted","Data":"28c10c714bc1ce313cdb2cba1ceb8739dc8c80219fcfbee6890e61afeca9a99e"} Jul 06 20:36:45.898537 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:45.898460 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-554b5bfdf7-s6pvc" podStartSLOduration=1.482179909 podStartE2EDuration="1.898438318s" totalImagesPullingTime="416.258409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:36:45.897776688 +0000 UTC m=+748.214099305" watchObservedRunningTime="2026-07-06 20:36:45.898438318 +0000 UTC m=+748.214760935" Jul 06 20:36:46.178033 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:46.177922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:46.360079 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:46.360044 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:36:54.025676 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:36:54.025638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:13.357317 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:37:13.357275 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:37:23.994201 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:37:23.994160 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:37:36.468658 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:37:36.468616 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:37:43.347350 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:37:43.347258 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:43.415333 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:37:43.415295 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:44.063374 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:37:44.063340 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:37:54.283233 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:37:54.283196 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:37:57.247883 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:37:57.247851 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:37:58.901649 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:37:58.901611 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:13.194883 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:13.194843 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:20.462705 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:20.462674 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:38:31.060777 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:31.060735 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:38:39.518387 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:39.518351 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:39.613275 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:39.613237 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:39.733228 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:39.733190 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:45.685703 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:45.685664 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:45.841891 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:45.841844 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:45.953108 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:45.953007 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:46.142214 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:46.142180 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:52.379915 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:52.379879 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:38:52.479317 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:38:52.479276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:09.452273 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:39:09.452191 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:39:15.364386 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:39:15.364346 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:39:18.255188 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:39:18.255157 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:39:18.259870 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:39:18.259846 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:39:19.074811 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:39:19.074763 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:39:27.283338 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:39:27.283301 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:39:36.270482 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:39:36.270445 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:39:47.594737 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:39:47.594697 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:39:58.875549 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:39:58.875516 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:40:10.276868 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:40:10.276827 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:40:16.467730 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:40:16.467695 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:40:24.369226 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:40:24.369190 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:40:33.364738 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:40:33.364702 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:40:49.009839 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:40:49.009750 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:40:52.319757 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:40:52.319728 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:41:00.079242 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:41:00.079208 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:41:23.574413 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:41:23.574366 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:41:33.779610 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:41:33.779575 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:41:51.396270 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:41:51.396214 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:42:01.415870 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:42:01.415835 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:44:18.291930 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:44:18.291901 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:44:18.294713 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:44:18.294690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:44:26.484831 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:44:26.484788 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:44:35.679702 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:44:35.679667 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:44:48.878285 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:44:48.878251 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:45:00.366068 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:45:00.366029 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:45:12.213947 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:45:12.213857 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:45:22.261947 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:45:22.261910 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:45:30.069526 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:45:30.069489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:45:35.612032 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:45:35.611994 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:45:35.694097 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:45:35.694060 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:45:40.765027 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:45:40.764987 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:45:49.460589 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:45:49.460555 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:45:59.956851 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:45:59.956812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:46:11.760496 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:46:11.760456 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:46:18.963300 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:46:18.963261 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:46:37.999429 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:46:37.999386 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:46:46.963605 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:46:46.963526 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:46:58.265829 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:46:58.265792 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:47:06.454718 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:47:06.454676 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:47:16.855110 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:47:16.855073 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:47:32.163611 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:47:32.163564 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:47:43.454477 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:47:43.454433 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:47:52.563094 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:47:52.563059 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:48:02.858402 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:02.858368 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:48:11.555675 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:11.555590 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:48:20.658443 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:20.658398 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-l52hq"] Jul 06 20:48:22.571765 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:22.571737 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:48:46.934640 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:46.934596 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-554b5bfdf7-s6pvc_80915357-4bfc-4c15-b4b8-6ff71b50b16b/authorino/0.log" Jul 06 20:48:52.575287 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:52.575258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f68bd595-sbnrk_8529670b-eed0-45c1-895f-431202acf617/copy-manifests/0.log" Jul 06 20:48:52.582389 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:52.582367 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f68bd595-sbnrk_8529670b-eed0-45c1-895f-431202acf617/manager/0.log" Jul 06 20:48:53.979119 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:53.979088 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-554b5bfdf7-s6pvc_80915357-4bfc-4c15-b4b8-6ff71b50b16b/authorino/0.log" Jul 06 20:48:54.687081 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:54.687053 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-l52hq_5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01/limitador/0.log" Jul 06 20:48:54.799061 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:54.799028 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pq586_a03b7e7d-5a70-49b9-87b4-5160939ac076/manager/0.log" Jul 06 20:48:55.481568 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:55.481540 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd668b4d4-7zkp7_16cfcb81-eb19-4a06-8f39-072ba4e177da/kube-auth-proxy/0.log" Jul 06 20:48:55.943039 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:55.943010 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c5764d8c-vljch_c342d055-b73d-4b1a-8b64-165bd700bd79/router/0.log" Jul 06 20:48:56.639048 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:56.639018 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbxjsjn_50e4e67f-0b2c-40f3-99b6-56f1f574bcc0/main/0.log" Jul 06 20:48:56.876694 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:48:56.876664 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-847t4_8068f949-c3db-46a9-9389-68a78aa663ae/main/0.log" Jul 06 20:49:01.505531 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:01.505492 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:01.611699 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:01.611667 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" limit=1024 Jul 06 20:49:04.458768 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:04.458736 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-22fms_8a67b74b-29bd-4f2f-9c20-d08eda17ff25/global-pull-secret-syncer/0.log" Jul 06 20:49:04.597739 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:04.597704 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-75cwj_d7bd04f2-db63-4ce3-8adb-87a95919989b/konnectivity-agent/0.log" Jul 06 20:49:04.734295 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:04.734206 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-213.ec2.internal_8afef05007b8d8fcc1b2b5da41446350/haproxy/0.log" Jul 06 20:49:09.687509 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:09.687419 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-554b5bfdf7-s6pvc_80915357-4bfc-4c15-b4b8-6ff71b50b16b/authorino/0.log" Jul 06 20:49:09.948428 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:09.948336 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-l52hq_5a2ecc4d-8b73-41d7-bca9-2fa7fb6b2f01/limitador/0.log" Jul 06 20:49:10.000228 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:10.000201 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pq586_a03b7e7d-5a70-49b9-87b4-5160939ac076/manager/0.log" Jul 06 20:49:11.482869 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.482845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bee19023-958c-480a-ac9e-b2b786ada5e5/alertmanager/0.log" Jul 06 20:49:11.506819 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.506788 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bee19023-958c-480a-ac9e-b2b786ada5e5/config-reloader/0.log" Jul 06 20:49:11.528779 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.528751 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bee19023-958c-480a-ac9e-b2b786ada5e5/kube-rbac-proxy-web/0.log" Jul 06 20:49:11.555944 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.555907 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bee19023-958c-480a-ac9e-b2b786ada5e5/kube-rbac-proxy/0.log" Jul 06 20:49:11.581631 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.581606 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bee19023-958c-480a-ac9e-b2b786ada5e5/kube-rbac-proxy-metric/0.log" Jul 06 20:49:11.603418 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.603386 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bee19023-958c-480a-ac9e-b2b786ada5e5/prom-label-proxy/0.log" Jul 06 20:49:11.628163 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.628136 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bee19023-958c-480a-ac9e-b2b786ada5e5/init-config-reloader/0.log" Jul 06 20:49:11.743640 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.743605 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-49x5q_1824d0d1-7017-4299-8ddf-a2400cd26d98/kube-state-metrics/0.log" Jul 06 20:49:11.780773 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.780747 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-49x5q_1824d0d1-7017-4299-8ddf-a2400cd26d98/kube-rbac-proxy-main/0.log" Jul 06 20:49:11.811751 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.811674 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-49x5q_1824d0d1-7017-4299-8ddf-a2400cd26d98/kube-rbac-proxy-self/0.log" Jul 06 20:49:11.859760 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.859734 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c6685b468-rxk7q_df2eaca8-a0e6-4838-b4e7-58bd1d7aeb25/metrics-server/0.log" Jul 06 20:49:11.900466 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:11.900441 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-l9wr7_bf8cf4a3-54f2-4d03-a3cf-ab20bb4fc2e7/monitoring-plugin/0.log" Jul 06 20:49:12.243009 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.242914 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xnr6n_04b4087f-6c73-42ee-866a-bfc6f28609c1/node-exporter/0.log" Jul 06 20:49:12.361963 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.361939 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xnr6n_04b4087f-6c73-42ee-866a-bfc6f28609c1/kube-rbac-proxy/0.log" Jul 06 20:49:12.418434 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.418409 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xnr6n_04b4087f-6c73-42ee-866a-bfc6f28609c1/init-textfile/0.log" Jul 06 20:49:12.602202 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.602168 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a98ba05-6a35-4b62-ac6a-ae69728bb5eb/prometheus/0.log" Jul 06 20:49:12.645956 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.645932 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a98ba05-6a35-4b62-ac6a-ae69728bb5eb/config-reloader/0.log" Jul 06 20:49:12.691566 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.691534 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a98ba05-6a35-4b62-ac6a-ae69728bb5eb/thanos-sidecar/0.log" Jul 06 20:49:12.761607 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.761576 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a98ba05-6a35-4b62-ac6a-ae69728bb5eb/kube-rbac-proxy-web/0.log" Jul 06 20:49:12.817878 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.817847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a98ba05-6a35-4b62-ac6a-ae69728bb5eb/kube-rbac-proxy/0.log" Jul 06 20:49:12.871697 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.871672 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a98ba05-6a35-4b62-ac6a-ae69728bb5eb/kube-rbac-proxy-thanos/0.log" Jul 06 20:49:12.914881 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:12.914850 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a98ba05-6a35-4b62-ac6a-ae69728bb5eb/init-config-reloader/0.log" Jul 06 20:49:13.207014 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:13.206915 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4f554887-5hzjv_45a18eba-f174-41d4-99d9-2089a72182ab/thanos-query/0.log" Jul 06 20:49:13.238531 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:13.238500 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4f554887-5hzjv_45a18eba-f174-41d4-99d9-2089a72182ab/kube-rbac-proxy-web/0.log" Jul 06 20:49:13.263698 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:13.263663 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4f554887-5hzjv_45a18eba-f174-41d4-99d9-2089a72182ab/kube-rbac-proxy/0.log" Jul 06 20:49:13.290813 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:13.290785 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4f554887-5hzjv_45a18eba-f174-41d4-99d9-2089a72182ab/prom-label-proxy/0.log" Jul 06 20:49:13.327456 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:13.327426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4f554887-5hzjv_45a18eba-f174-41d4-99d9-2089a72182ab/kube-rbac-proxy-rules/0.log" Jul 06 20:49:13.369305 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:13.369279 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c4f554887-5hzjv_45a18eba-f174-41d4-99d9-2089a72182ab/kube-rbac-proxy-metrics/0.log" Jul 06 20:49:14.736135 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.736100 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh"] Jul 06 20:49:14.739709 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.739689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.743075 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.743053 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xk9jl\"/\"openshift-service-ca.crt\"" Jul 06 20:49:14.743188 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.743086 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xk9jl\"/\"kube-root-ca.crt\"" Jul 06 20:49:14.743865 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.743847 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xk9jl\"/\"default-dockercfg-8nn8l\"" Jul 06 20:49:14.756966 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.756941 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh"] Jul 06 20:49:14.839719 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.839684 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-lib-modules\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.839902 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.839747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-proc\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.839902 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.839768 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-podres\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.839902 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.839804 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-sys\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.839902 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.839828 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwbzx\" (UniqueName: \"kubernetes.io/projected/06a49b61-8727-44b7-a37c-6b941f8fb2a2-kube-api-access-rwbzx\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.940739 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.940690 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-proc\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.940739 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.940735 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-podres\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.941036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.940785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-sys\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.941036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.940818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwbzx\" (UniqueName: \"kubernetes.io/projected/06a49b61-8727-44b7-a37c-6b941f8fb2a2-kube-api-access-rwbzx\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.941036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.940830 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-proc\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.941036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.940883 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-lib-modules\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.941036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.940904 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-sys\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.941036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.940921 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-podres\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.941036 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.941025 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06a49b61-8727-44b7-a37c-6b941f8fb2a2-lib-modules\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:14.949654 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:14.949630 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwbzx\" (UniqueName: \"kubernetes.io/projected/06a49b61-8727-44b7-a37c-6b941f8fb2a2-kube-api-access-rwbzx\") pod \"perf-node-gather-daemonset-hlgrh\" (UID: \"06a49b61-8727-44b7-a37c-6b941f8fb2a2\") " pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:15.049727 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:15.049690 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:15.204470 ip-10-0-136-213 kubenswrapper[2579]: W0706 20:49:15.204441 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06a49b61_8727_44b7_a37c_6b941f8fb2a2.slice/crio-72c088c5a3066c38e711dac8b81542be49b00b437abe374487c85aa96d2d7d87 WatchSource:0}: Error finding container 72c088c5a3066c38e711dac8b81542be49b00b437abe374487c85aa96d2d7d87: Status 404 returned error can't find the container with id 72c088c5a3066c38e711dac8b81542be49b00b437abe374487c85aa96d2d7d87 Jul 06 20:49:15.206436 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:15.206410 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh"] Jul 06 20:49:15.440443 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:15.440412 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" event={"ID":"06a49b61-8727-44b7-a37c-6b941f8fb2a2","Type":"ContainerStarted","Data":"62f59aadd30354b5fc96c47f7a6fe289789a30dc9e4a9baed3da6ae322c6e136"} Jul 06 20:49:15.440615 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:15.440461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" event={"ID":"06a49b61-8727-44b7-a37c-6b941f8fb2a2","Type":"ContainerStarted","Data":"72c088c5a3066c38e711dac8b81542be49b00b437abe374487c85aa96d2d7d87"} Jul 06 20:49:15.440615 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:15.440484 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:15.459661 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:15.459610 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" podStartSLOduration=1.459593195 podStartE2EDuration="1.459593195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:49:15.458842234 +0000 UTC m=+1497.775164852" watchObservedRunningTime="2026-07-06 20:49:15.459593195 +0000 UTC m=+1497.775915810" Jul 06 20:49:17.521687 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:17.521657 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c7sfk_f6c8eeb7-12f5-4594-b3ac-1c636928e609/dns/0.log" Jul 06 20:49:17.559013 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:17.558952 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c7sfk_f6c8eeb7-12f5-4594-b3ac-1c636928e609/kube-rbac-proxy/0.log" Jul 06 20:49:17.684748 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:17.684720 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-r792d_52d8bc32-2d42-49fb-9a90-d7403c5e6766/dns-node-resolver/0.log" Jul 06 20:49:18.304439 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:18.304410 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b2phd_cf3cb7e8-80bb-4ca7-b3d2-51d220e87f4f/node-ca/0.log" Jul 06 20:49:18.324432 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:18.324404 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:49:18.326454 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:18.326432 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bzmx8_6a4e538e-cd87-4383-b937-ad0a9ca86f10/ovn-acl-logging/0.log" Jul 06 20:49:19.498149 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:19.498118 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd668b4d4-7zkp7_16cfcb81-eb19-4a06-8f39-072ba4e177da/kube-auth-proxy/0.log" Jul 06 20:49:19.655770 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:19.655739 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c5764d8c-vljch_c342d055-b73d-4b1a-8b64-165bd700bd79/router/0.log" Jul 06 20:49:20.336858 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:20.336828 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vsj4b_52e3233d-4675-4171-b69d-aabc47fb581c/serve-healthcheck-canary/0.log" Jul 06 20:49:20.858226 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:20.858198 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-pddnm_2def55ac-aa00-467f-ac1f-2724be0c6f19/insights-operator/0.log" Jul 06 20:49:20.858612 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:20.858567 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-pddnm_2def55ac-aa00-467f-ac1f-2724be0c6f19/insights-operator/1.log" Jul 06 20:49:21.003175 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:21.003138 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhtpl_7f65429d-ab7a-4fef-8295-225348965095/kube-rbac-proxy/0.log" Jul 06 20:49:21.028271 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:21.028248 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhtpl_7f65429d-ab7a-4fef-8295-225348965095/exporter/0.log" Jul 06 20:49:21.053734 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:21.053704 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jhtpl_7f65429d-ab7a-4fef-8295-225348965095/extractor/0.log" Jul 06 20:49:21.454955 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:21.454928 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xk9jl/perf-node-gather-daemonset-hlgrh" Jul 06 20:49:24.349702 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:24.349671 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f68bd595-sbnrk_8529670b-eed0-45c1-895f-431202acf617/manager/0.log" Jul 06 20:49:24.373809 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:24.373787 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f68bd595-sbnrk_8529670b-eed0-45c1-895f-431202acf617/copy-manifests/0.log" Jul 06 20:49:25.679247 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:25.679218 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd668b4d4-7zkp7_16cfcb81-eb19-4a06-8f39-072ba4e177da/kube-auth-proxy/0.log" Jul 06 20:49:25.725037 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:25.725008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d444c84c5-fzlvc_d5df2f4d-0ed3-4219-bd5a-899cbf59ece7/manager/0.log" Jul 06 20:49:25.804439 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:25.804412 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c5764d8c-vljch_c342d055-b73d-4b1a-8b64-165bd700bd79/router/0.log" Jul 06 20:49:27.013653 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:27.013624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-cd668b4d4-7zkp7_16cfcb81-eb19-4a06-8f39-072ba4e177da/kube-auth-proxy/0.log" Jul 06 20:49:27.177031 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:27.176972 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c5764d8c-vljch_c342d055-b73d-4b1a-8b64-165bd700bd79/router/0.log" Jul 06 20:49:30.796914 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:30.796882 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-w4w5j_02a4200b-04e8-4e47-bc96-445f1d8d32e8/migrator/0.log" Jul 06 20:49:30.819654 ip-10-0-136-213 kubenswrapper[2579]: I0706 20:49:30.819624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-w4w5j_02a4200b-04e8-4e47-bc96-445f1d8d32e8/graceful-termination/0.log"